2026-03-12 19:54:51 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-12 19:54:51 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-12 19:54:51 [arval.uk] INFO: Starting spider arval.uk [deploy-check: 2026-03-12T15:10]
2026-03-12 19:54:51 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-12 19:54:51 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-12 19:54:51 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-12 19:54:51 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-12 19:54:51 [scrapy.extensions.telnet] INFO: Telnet Password: 06e8b6f867659b3a
2026-03-12 19:54:51 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-12 19:54:51 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_DELAY': 1,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/arval.uk/2026-03-12T19_54_44.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-12 19:54:51 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-12 19:54:51 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-12 19:54:51 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-12 19:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-12 19:54:51 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-12 19:54:51 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-12 19:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-12 19:54:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2097
2026-03-12 19:54:51 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-12 19:54:51 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-12 19:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-12 19:54:51 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-12 19:54:51 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-12 19:54:51 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-12 19:54:51 [scrapy.core.engine] INFO: Spider opened
2026-03-12 19:54:51 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-12 19:54:51 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-12 19:54:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-12 19:54:51 [scrapy-playwright] INFO: Starting download handler
2026-03-12 19:54:51 [scrapy-playwright] INFO: Starting download handler
2026-03-12 19:54:56 [scrapy-playwright] INFO: Launching browser firefox
2026-03-12 19:54:57 [scrapy-playwright] INFO: Browser firefox launched
2026-03-12 19:54:57 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-12 19:54:58 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-12 19:54:58 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/> (resource type: document)
2026-03-12 19:54:58 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://autoselect.arval.co.uk/>
2026-03-12 19:54:58 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/> (resource type: document)
2026-03-12 19:54:58 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://autoselect.arval.co.uk/>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/styles/fonts/bnpp-sans/bnpp-sans.woff2> (resource type: font, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/styles/fonts/bnpp-sans/bnpp-sans-bold.woff2> (resource type: font, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/styles/fonts/bnpp-sans/bnpp-sans-light.woff2> (resource type: font, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/styles/fonts/bnpp-sans-condensed/bnpp-sans-cond-v2.woff2> (resource type: font, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/styles/fonts/bnpp-sans-condensed/bnpp-sans-cond-bold-v2.woff2> (resource type: font, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/styles/arval_styles/arval.css> (resource type: stylesheet, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/scripts/arval_scripts/polyfills.js> (resource type: script, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/scripts/arval_scripts/runtime.min.js> (resource type: script, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/scripts/arval_scripts/arval.js> (resource type: script, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/scripts/arval_scripts/vandor.min.js> (resource type: script, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/images/arval-autoselect-logo.png> (resource type: image, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://autoselect.arval.co.uk/images/arval-autoselect-logo.png>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/CountriesData/UK/images/banners/banner.png> (resource type: image, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://autoselect.arval.co.uk/CountriesData/UK/images/banners/banner.png>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/CountriesData/UK/images/newuk/images/Spring/AutoSelectHomeSpring.jpg> (resource type: image, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://autoselect.arval.co.uk/CountriesData/UK/images/newuk/images/Spring/AutoSelectHomeSpring.jpg>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.2.min.js> (resource type: script, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://autoselect.arval.co.uk/styles/fonts/bnpp-sans/bnpp-sans.woff2>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://autoselect.arval.co.uk/styles/fonts/bnpp-sans-condensed/bnpp-sans-cond-bold-v2.woff2>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://autoselect.arval.co.uk/styles/fonts/bnpp-sans/bnpp-sans-bold.woff2>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://autoselect.arval.co.uk/styles/arval_styles/arval.css>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://autoselect.arval.co.uk/scripts/arval_scripts/polyfills.js>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://autoselect.arval.co.uk/styles/fonts/bnpp-sans/bnpp-sans-light.woff2>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-MVPKT57> (resource type: script, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-MVPKT57>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://autoselect.arval.co.uk/scripts/arval_scripts/runtime.min.js>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://autoselect.arval.co.uk/scripts/arval_scripts/arval.js>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://autoselect.arval.co.uk/scripts/arval_scripts/vandor.min.js>
2026-03-12 19:54:59 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://autoselect.arval.co.uk/styles/fonts/bnpp-sans-condensed/bnpp-sans-cond-v2.woff2>
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.2.min.js>
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/images/arval-autoselect-logo.png> (resource type: image, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://autoselect.arval.co.uk/images/arval-autoselect-logo.png>
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/CountriesData/UK/images/banners/banner.png> (resource type: image, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://autoselect.arval.co.uk/CountriesData/UK/images/banners/banner.png>
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/CountriesData/UK/images/newuk/images/Spring/AutoSelectHomeSpring.jpg> (resource type: image, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://autoselect.arval.co.uk/CountriesData/UK/images/newuk/images/Spring/AutoSelectHomeSpring.jpg>
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/styles/arval_icons/android-icon-192x192.png> (resource type: image, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://autoselect.arval.co.uk/styles/arval_icons/android-icon-192x192.png>
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://autoselect.arval.co.uk/styles/arval_icons/favicon-16x16.png> (resource type: image, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://autoselect.arval.co.uk/styles/arval_icons/favicon-16x16.png>
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/?pageSize=12&purchaseOption=release&reservationLabels=available&_=1773345300177> (resource type: xhr, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Filters/3?purchaseOption=release&reservationLabels=available> (resource type: xhr, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Filters/3?purchaseOption=sale&reservationLabels=available&orderBy=reLeasePriceGross|asc> (resource type: xhr, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:55:00 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://autoselect.arval.co.uk/)
2026-03-12 19:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://autoselect.arval.co.uk> (referer: None) ['playwright']
2026-03-12 19:55:00 [arval.uk] INFO: Scrapy-formatted cookies: [{'name': 'ARRAffinity', 'value': '5f4dbd6a5f3bbb38bdbcbc8f545e992b01d45d94bac4a7318fa89b741ba513a9', 'domain': '.autoselect.arval.co.uk', 'path': '/'}, {'name': 'ARRAffinitySameSite', 'value': '5f4dbd6a5f3bbb38bdbcbc8f545e992b01d45d94bac4a7318fa89b741ba513a9', 'domain': '.autoselect.arval.co.uk', 'path': '/'}, {'name': 'ai_user', 'value': 'vva9mpEUMnQCnR2DpuQGEU|2026-03-12T19:55:00.195Z', 'domain': 'autoselect.arval.co.uk', 'path': '/'}, {'name': 'ai_session', 'value': 'RAmxdZB+ohqAU2Usn8Bd7A|1773345300200|1773345300200', 'domain': 'autoselect.arval.co.uk', 'path': '/'}]
2026-03-12 19:55:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3?orderBy=salePriceGross%7Casc&pageNumber=1&pageSize=20&purchaseOption=sale&reservationLabels=available> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:03 [arval.uk] INFO: Found listing with ID: 115424
2026-03-12 19:55:03 [arval.uk] INFO: Scrape type for 115424: 1
2026-03-12 19:55:03 [arval.uk] INFO: Found listing with ID: 127908
2026-03-12 19:55:03 [arval.uk] INFO: Scrape type for 127908: 1
2026-03-12 19:55:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:03 [arval.uk] INFO: Found listing with ID: 114780
2026-03-12 19:55:03 [arval.uk] INFO: Scrape type for 114780: 1
2026-03-12 19:55:03 [arval.uk] INFO: Found listing with ID: 124612
2026-03-12 19:55:03 [arval.uk] INFO: Scrape type for 124612: 1
2026-03-12 19:55:03 [arval.uk] INFO: Found listing with ID: 116045
2026-03-12 19:55:03 [arval.uk] INFO: Scrape type for 116045: 1
2026-03-12 19:55:03 [arval.uk] INFO: Found listing with ID: 128153
2026-03-12 19:55:03 [arval.uk] INFO: Scrape type for 128153: 1
2026-03-12 19:55:03 [arval.uk] INFO: Found listing with ID: 122094
2026-03-12 19:55:03 [arval.uk] INFO: Scrape type for 122094: 1
2026-03-12 19:55:03 [arval.uk] INFO: Found listing with ID: 114728
2026-03-12 19:55:03 [arval.uk] INFO: Scrape type for 114728: 1
2026-03-12 19:55:03 [arval.uk] INFO: Found listing with ID: 116044
2026-03-12 19:55:03 [arval.uk] INFO: Scrape type for 116044: 1
2026-03-12 19:55:03 [arval.uk] INFO: Found listing with ID: 121766
2026-03-12 19:55:04 [arval.uk] INFO: Scrape type for 121766: 1
2026-03-12 19:55:04 [arval.uk] INFO: Found listing with ID: 127504
2026-03-12 19:55:04 [arval.uk] INFO: Scrape type for 127504: 1
2026-03-12 19:55:04 [arval.uk] INFO: Found listing with ID: 121493
2026-03-12 19:55:04 [arval.uk] INFO: Scrape type for 121493: 1
2026-03-12 19:55:04 [arval.uk] INFO: Found listing with ID: 119801
2026-03-12 19:55:04 [arval.uk] INFO: Scrape type for 119801: 1
2026-03-12 19:55:04 [arval.uk] INFO: Found listing with ID: 128926
2026-03-12 19:55:04 [arval.uk] INFO: Scrape type for 128926: 1
2026-03-12 19:55:04 [arval.uk] INFO: Found listing with ID: 110459
2026-03-12 19:55:04 [arval.uk] INFO: Scrape type for 110459: 1
2026-03-12 19:55:04 [arval.uk] INFO: Found listing with ID: 118910
2026-03-12 19:55:04 [arval.uk] INFO: Scrape type for 118910: 1
2026-03-12 19:55:04 [arval.uk] INFO: Found listing with ID: 113847
2026-03-12 19:55:04 [arval.uk] INFO: Scrape type for 113847: 1
2026-03-12 19:55:04 [arval.uk] INFO: Found listing with ID: 125688
2026-03-12 19:55:04 [arval.uk] INFO: Scrape type for 125688: 1
2026-03-12 19:55:04 [arval.uk] INFO: Found listing with ID: 113197
2026-03-12 19:55:04 [arval.uk] INFO: Scrape type for 113197: 1
2026-03-12 19:55:04 [arval.uk] INFO: Found listing with ID: 126844
2026-03-12 19:55:04 [arval.uk] INFO: Scrape type for 126844: 1
2026-03-12 19:55:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115424> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3cd838b-8975-5122-82c7-6fa736e5da53 with identifier: 115424
2026-03-12 19:55:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3cd838b-8975-5122-82c7-6fa736e5da53 with scrape type 1
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3cd838b-8975-5122-82c7-6fa736e5da53
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/0.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/1.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/2.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/3.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/4.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/5.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/6.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/7.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/8.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/9.jpeg not downloaded yet
2026-03-12 19:55:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127908> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd with identifier: 127908
2026-03-12 19:55:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd with scrape type 1
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/0.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/1.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/2.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/3.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/4.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/5.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/6.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/7.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/8.jpeg not downloaded yet
2026-03-12 19:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/9.jpeg not downloaded yet
2026-03-12 19:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115424)
2026-03-12 19:55:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-12 19:55:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 36f195bf-b061-498b-bebd-997f7853af90
2026-03-12 19:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67772010>
2026-03-12 19:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-12 19:55:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2097
2026-03-12 19:55:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxdev.blob.core.windows.net:443
2026-03-12 19:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/9.jpeg saved to cache
2026-03-12 19:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3cd838b-8975-5122-82c7-6fa736e5da53
2026-03-12 19:55:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127908)
2026-03-12 19:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c12ead0>
2026-03-12 19:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/9.jpeg saved to cache
2026-03-12 19:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd
2026-03-12 19:55:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127908)
2026-03-12 19:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718dd50>
2026-03-12 19:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/8.jpeg saved to cache
2026-03-12 19:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd
2026-03-12 19:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124612> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63b57e2e-a6cb-5e45-be77-34d5575e17c4 with identifier: 124612
2026-03-12 19:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4 with scrape type 1
2026-03-12 19:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4
2026-03-12 19:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/0.jpeg not downloaded yet
2026-03-12 19:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/1.jpeg not downloaded yet
2026-03-12 19:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/2.jpeg not downloaded yet
2026-03-12 19:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/3.jpeg not downloaded yet
2026-03-12 19:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/4.jpeg not downloaded yet
2026-03-12 19:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/5.jpeg not downloaded yet
2026-03-12 19:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/6.jpeg not downloaded yet
2026-03-12 19:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/7.jpeg not downloaded yet
2026-03-12 19:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/8.jpeg not downloaded yet
2026-03-12 19:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/9.jpeg not downloaded yet
2026-03-12 19:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114780> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75be1a3b-cf84-5e07-82ce-bb7199261017 with identifier: 114780
2026-03-12 19:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75be1a3b-cf84-5e07-82ce-bb7199261017 with scrape type 1
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75be1a3b-cf84-5e07-82ce-bb7199261017
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/0.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/1.jpeg not downloaded yet
2026-03-12 19:55:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/2.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/3.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/4.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/5.jpeg not downloaded yet
2026-03-12 19:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127908)
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/6.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/7.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/8.jpeg not downloaded yet
2026-03-12 19:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116045> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/9.jpeg not downloaded yet
2026-03-12 19:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718db90>
2026-03-12 19:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/7.jpeg saved to cache
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd
2026-03-12 19:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a81de434-b548-50c8-bdf7-d1c0d8e0932f with identifier: 116045
2026-03-12 19:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a81de434-b548-50c8-bdf7-d1c0d8e0932f with scrape type 1
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a81de434-b548-50c8-bdf7-d1c0d8e0932f
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/0.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/1.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/2.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/3.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/4.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/5.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/6.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/7.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/8.jpeg not downloaded yet
2026-03-12 19:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/9.jpeg not downloaded yet
2026-03-12 19:55:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127908)
2026-03-12 19:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713a490>
2026-03-12 19:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/6.jpeg saved to cache
2026-03-12 19:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd
2026-03-12 19:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124612)
2026-03-12 19:55:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1e510>
2026-03-12 19:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/9.jpeg saved to cache
2026-03-12 19:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4
2026-03-12 19:55:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114780)
2026-03-12 19:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677042d0>
2026-03-12 19:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/5.jpeg saved to cache
2026-03-12 19:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75be1a3b-cf84-5e07-82ce-bb7199261017
2026-03-12 19:55:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114780)
2026-03-12 19:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67631990>
2026-03-12 19:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/8.jpeg saved to cache
2026-03-12 19:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75be1a3b-cf84-5e07-82ce-bb7199261017
2026-03-12 19:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122094> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f6226e1-c486-59ae-a78d-600ffe82593d with identifier: 122094
2026-03-12 19:55:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f6226e1-c486-59ae-a78d-600ffe82593d with scrape type 1
2026-03-12 19:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f6226e1-c486-59ae-a78d-600ffe82593d
2026-03-12 19:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/0.jpeg not downloaded yet
2026-03-12 19:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/1.jpeg not downloaded yet
2026-03-12 19:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/2.jpeg not downloaded yet
2026-03-12 19:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/3.jpeg not downloaded yet
2026-03-12 19:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/4.jpeg not downloaded yet
2026-03-12 19:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/5.jpeg not downloaded yet
2026-03-12 19:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/6.jpeg not downloaded yet
2026-03-12 19:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/7.jpeg not downloaded yet
2026-03-12 19:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/8.jpeg not downloaded yet
2026-03-12 19:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/9.jpeg not downloaded yet
2026-03-12 19:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116045)
2026-03-12 19:55:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677d9750>
2026-03-12 19:55:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/9.jpeg saved to cache
2026-03-12 19:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a81de434-b548-50c8-bdf7-d1c0d8e0932f
2026-03-12 19:55:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127504> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f0a1100-b36b-5a3e-b855-7eff7ee22eda with identifier: 127504
2026-03-12 19:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda with scrape type 1
2026-03-12 19:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda
2026-03-12 19:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/0.jpeg not downloaded yet
2026-03-12 19:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/1.jpeg not downloaded yet
2026-03-12 19:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/2.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/3.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/4.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/5.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/6.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/7.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/8.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/9.jpeg not downloaded yet
2026-03-12 19:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116045)
2026-03-12 19:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16ded0>
2026-03-12 19:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/8.jpeg saved to cache
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a81de434-b548-50c8-bdf7-d1c0d8e0932f
2026-03-12 19:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121493> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2429a3a6-3d96-5981-82ab-340d0e726821 with identifier: 121493
2026-03-12 19:55:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2429a3a6-3d96-5981-82ab-340d0e726821 with scrape type 1
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2429a3a6-3d96-5981-82ab-340d0e726821
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/0.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/1.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/2.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/3.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/4.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/5.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/6.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/7.jpeg not downloaded yet
2026-03-12 19:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/8.jpeg not downloaded yet
2026-03-12 19:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/9.jpeg not downloaded yet
2026-03-12 19:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116045)
2026-03-12 19:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6602fc90>
2026-03-12 19:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/7.jpeg saved to cache
2026-03-12 19:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a81de434-b548-50c8-bdf7-d1c0d8e0932f
2026-03-12 19:55:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116045)
2026-03-12 19:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67663ad0>
2026-03-12 19:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/6.jpeg saved to cache
2026-03-12 19:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a81de434-b548-50c8-bdf7-d1c0d8e0932f
2026-03-12 19:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128926> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0950cd13-0275-5a28-bcaf-bff3d8c8eba2 with identifier: 128926
2026-03-12 19:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2 with scrape type 1
2026-03-12 19:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2
2026-03-12 19:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/0.jpeg not downloaded yet
2026-03-12 19:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/1.jpeg not downloaded yet
2026-03-12 19:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/2.jpeg not downloaded yet
2026-03-12 19:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/3.jpeg not downloaded yet
2026-03-12 19:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/4.jpeg not downloaded yet
2026-03-12 19:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/5.jpeg not downloaded yet
2026-03-12 19:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/6.jpeg not downloaded yet
2026-03-12 19:55:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/7.jpeg not downloaded yet
2026-03-12 19:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/8.jpeg not downloaded yet
2026-03-12 19:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/9.jpeg not downloaded yet
2026-03-12 19:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116045)
2026-03-12 19:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119801> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/110459> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717a690>
2026-03-12 19:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/5.jpeg saved to cache
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a81de434-b548-50c8-bdf7-d1c0d8e0932f
2026-03-12 19:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1515c802-9134-5000-9d3d-3acfd88e0cb7 with identifier: 119801
2026-03-12 19:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1515c802-9134-5000-9d3d-3acfd88e0cb7 with scrape type 1
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1515c802-9134-5000-9d3d-3acfd88e0cb7
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/0.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/1.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/2.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff269da7-48c7-599d-9006-6437dfaa9ef5 with identifier: 110459
2026-03-12 19:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff269da7-48c7-599d-9006-6437dfaa9ef5 with scrape type 1
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff269da7-48c7-599d-9006-6437dfaa9ef5
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/0.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/3.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/1.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/4.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/2.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/5.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/3.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/6.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/4.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/7.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/5.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/8.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/6.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/9.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/7.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/8.jpeg not downloaded yet
2026-03-12 19:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/9.jpeg not downloaded yet
2026-03-12 19:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128153> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116044> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4 with identifier: 128153
2026-03-12 19:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4 with scrape type 1
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/0.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/1.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/2.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/3.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/4.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/5.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/6.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de265a74-2122-5399-8d58-b44da9430d6e with identifier: 116044
2026-03-12 19:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de265a74-2122-5399-8d58-b44da9430d6e with scrape type 1
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de265a74-2122-5399-8d58-b44da9430d6e
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/0.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/7.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/1.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/8.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/2.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/9.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/3.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/4.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/5.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/6.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/7.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/8.jpeg not downloaded yet
2026-03-12 19:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118910> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/9.jpeg not downloaded yet
2026-03-12 19:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122094)
2026-03-12 19:55:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4c5d98-5198-5531-8efb-04b266a31189 with identifier: 118910
2026-03-12 19:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4c5d98-5198-5531-8efb-04b266a31189 with scrape type 1
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a4c5d98-5198-5531-8efb-04b266a31189
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/0.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/1.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/2.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/3.jpeg not downloaded yet
2026-03-12 19:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a5050>
2026-03-12 19:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/9.jpeg saved to cache
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f6226e1-c486-59ae-a78d-600ffe82593d
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/4.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/5.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/6.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/7.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/8.jpeg not downloaded yet
2026-03-12 19:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/9.jpeg not downloaded yet
2026-03-12 19:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121766> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208 with identifier: 121766
2026-03-12 19:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208 with scrape type 1
2026-03-12 19:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208
2026-03-12 19:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/0.jpeg not downloaded yet
2026-03-12 19:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/1.jpeg not downloaded yet
2026-03-12 19:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/2.jpeg not downloaded yet
2026-03-12 19:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/3.jpeg not downloaded yet
2026-03-12 19:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/4.jpeg not downloaded yet
2026-03-12 19:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/5.jpeg not downloaded yet
2026-03-12 19:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/6.jpeg not downloaded yet
2026-03-12 19:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/7.jpeg not downloaded yet
2026-03-12 19:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/8.jpeg not downloaded yet
2026-03-12 19:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/9.jpeg not downloaded yet
2026-03-12 19:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122094)
2026-03-12 19:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c117fd0>
2026-03-12 19:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/8.jpeg saved to cache
2026-03-12 19:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f6226e1-c486-59ae-a78d-600ffe82593d
2026-03-12 19:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3?orderBy=salePriceGross%7Casc&pageNumber=2&pageSize=20&purchaseOption=sale&reservationLabels=available> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 118732
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 118732: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 123153
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 123153: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 117801
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 117801: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 123931
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 123931: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 127046
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 127046: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 122159
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 122159: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 122960
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 122960: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 124139
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 124139: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 116313
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 116313: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 126269
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 126269: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 128157
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 128157: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 125045
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 125045: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 127537
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 127537: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 127544
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 127544: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 128780
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 128780: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 109683
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 109683: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 127057
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 127057: 1
2026-03-12 19:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127504)
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 118146
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 118146: 1
2026-03-12 19:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 118271
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 118271: 1
2026-03-12 19:55:25 [arval.uk] INFO: Found listing with ID: 113137
2026-03-12 19:55:25 [arval.uk] INFO: Scrape type for 113137: 1
2026-03-12 19:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660af0d0>
2026-03-12 19:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/9.jpeg saved to cache
2026-03-12 19:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda
2026-03-12 19:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127504)
2026-03-12 19:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ae610>
2026-03-12 19:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/8.jpeg saved to cache
2026-03-12 19:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda
2026-03-12 19:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121493)
2026-03-12 19:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66041ed0>
2026-03-12 19:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/9.jpeg saved to cache
2026-03-12 19:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2429a3a6-3d96-5981-82ab-340d0e726821
2026-03-12 19:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127057> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb0e5c8d-224a-5d26-9bf9-9fbdf014f687 with identifier: 127057
2026-03-12 19:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687 with scrape type 1
2026-03-12 19:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687
2026-03-12 19:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/0.jpeg not downloaded yet
2026-03-12 19:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/1.jpeg not downloaded yet
2026-03-12 19:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/2.jpeg not downloaded yet
2026-03-12 19:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/3.jpeg not downloaded yet
2026-03-12 19:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/4.jpeg not downloaded yet
2026-03-12 19:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/5.jpeg not downloaded yet
2026-03-12 19:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/6.jpeg not downloaded yet
2026-03-12 19:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/7.jpeg not downloaded yet
2026-03-12 19:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/8.jpeg not downloaded yet
2026-03-12 19:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/9.jpeg not downloaded yet
2026-03-12 19:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121493)
2026-03-12 19:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6767b6d0>
2026-03-12 19:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/8.jpeg saved to cache
2026-03-12 19:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2429a3a6-3d96-5981-82ab-340d0e726821
2026-03-12 19:55:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3?orderBy=salePriceGross%7Casc&pageNumber=3&pageSize=20&purchaseOption=sale&reservationLabels=available> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 122950
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 122950: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 128562
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 128562: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 123340
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 123340: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 128558
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 128558: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 115009
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 115009: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 121817
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 121817: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 123998
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 123998: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 124007
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 124007: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 116799
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 116799: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 124141
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 124141: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 128779
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 128779: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 119109
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 119109: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 121919
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 121919: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 128882
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 128882: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 116915
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 116915: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 127067
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 127067: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 129353
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 129353: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 127492
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 127492: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 130269
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 130269: 1
2026-03-12 19:55:30 [arval.uk] INFO: Found listing with ID: 119767
2026-03-12 19:55:30 [arval.uk] INFO: Scrape type for 119767: 1
2026-03-12 19:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113137> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78f95676-02ed-5666-b076-efe227a54063 with identifier: 113137
2026-03-12 19:55:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78f95676-02ed-5666-b076-efe227a54063 with scrape type 1
2026-03-12 19:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78f95676-02ed-5666-b076-efe227a54063
2026-03-12 19:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/0.jpeg not downloaded yet
2026-03-12 19:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/1.jpeg not downloaded yet
2026-03-12 19:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/2.jpeg not downloaded yet
2026-03-12 19:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/3.jpeg not downloaded yet
2026-03-12 19:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/4.jpeg not downloaded yet
2026-03-12 19:55:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/5.jpeg not downloaded yet
2026-03-12 19:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/6.jpeg not downloaded yet
2026-03-12 19:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/7.jpeg not downloaded yet
2026-03-12 19:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/8.jpeg not downloaded yet
2026-03-12 19:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/9.jpeg not downloaded yet
2026-03-12 19:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121493)
2026-03-12 19:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677eb950>
2026-03-12 19:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/7.jpeg saved to cache
2026-03-12 19:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2429a3a6-3d96-5981-82ab-340d0e726821
2026-03-12 19:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128926)
2026-03-12 19:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3?orderBy=salePriceGross%7Casc&pageNumber=4&pageSize=20&purchaseOption=sale&reservationLabels=available> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67638a90>
2026-03-12 19:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/9.jpeg saved to cache
2026-03-12 19:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 123598
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 123598: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 127326
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 127326: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 124560
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 124560: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 121092
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 121092: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 125534
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 125534: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 127503
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 127503: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 127891
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 127891: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 128778
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 128778: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 127539
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 127539: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 125156
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 125156: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 121186
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 121186: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 126485
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 126485: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 117307
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 117307: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 121195
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 121195: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 124453
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 124453: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 116646
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 116646: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 128924
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 128924: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 128787
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 128787: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 123795
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 123795: 1
2026-03-12 19:55:33 [arval.uk] INFO: Found listing with ID: 129371
2026-03-12 19:55:33 [arval.uk] INFO: Scrape type for 129371: 1
2026-03-12 19:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114728> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c4a088e-9921-5709-9e94-3706151351d9 with identifier: 114728
2026-03-12 19:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c4a088e-9921-5709-9e94-3706151351d9 with scrape type 1
2026-03-12 19:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c4a088e-9921-5709-9e94-3706151351d9
2026-03-12 19:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/0.jpeg not downloaded yet
2026-03-12 19:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/1.jpeg not downloaded yet
2026-03-12 19:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/2.jpeg not downloaded yet
2026-03-12 19:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/3.jpeg not downloaded yet
2026-03-12 19:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/4.jpeg not downloaded yet
2026-03-12 19:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/5.jpeg not downloaded yet
2026-03-12 19:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/6.jpeg not downloaded yet
2026-03-12 19:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/7.jpeg not downloaded yet
2026-03-12 19:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/8.jpeg not downloaded yet
2026-03-12 19:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/9.jpeg not downloaded yet
2026-03-12 19:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128926)
2026-03-12 19:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6767a190>
2026-03-12 19:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/8.jpeg saved to cache
2026-03-12 19:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2
2026-03-12 19:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128926)
2026-03-12 19:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677d8e90>
2026-03-12 19:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/7.jpeg saved to cache
2026-03-12 19:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2
2026-03-12 19:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/110459)
2026-03-12 19:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16e310>
2026-03-12 19:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/9.jpeg saved to cache
2026-03-12 19:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff269da7-48c7-599d-9006-6437dfaa9ef5
2026-03-12 19:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/110459)
2026-03-12 19:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6608c090>
2026-03-12 19:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/8.jpeg saved to cache
2026-03-12 19:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff269da7-48c7-599d-9006-6437dfaa9ef5
2026-03-12 19:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116044)
2026-03-12 19:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660516d0>
2026-03-12 19:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/8.jpeg saved to cache
2026-03-12 19:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de265a74-2122-5399-8d58-b44da9430d6e
2026-03-12 19:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116044)
2026-03-12 19:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67612dd0>
2026-03-12 19:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/9.jpeg saved to cache
2026-03-12 19:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de265a74-2122-5399-8d58-b44da9430d6e
2026-03-12 19:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118910)
2026-03-12 19:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16e710>
2026-03-12 19:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/9.jpeg saved to cache
2026-03-12 19:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a4c5d98-5198-5531-8efb-04b266a31189
2026-03-12 19:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118271> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29f554a8-753f-5367-a09c-a71edb76efe3 with identifier: 118271
2026-03-12 19:55:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29f554a8-753f-5367-a09c-a71edb76efe3 with scrape type 1
2026-03-12 19:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29f554a8-753f-5367-a09c-a71edb76efe3
2026-03-12 19:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/0.jpeg not downloaded yet
2026-03-12 19:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/1.jpeg not downloaded yet
2026-03-12 19:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/2.jpeg not downloaded yet
2026-03-12 19:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/3.jpeg not downloaded yet
2026-03-12 19:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/4.jpeg not downloaded yet
2026-03-12 19:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/5.jpeg not downloaded yet
2026-03-12 19:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/6.jpeg not downloaded yet
2026-03-12 19:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/7.jpeg not downloaded yet
2026-03-12 19:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/8.jpeg not downloaded yet
2026-03-12 19:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/9.jpeg not downloaded yet
2026-03-12 19:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3?orderBy=salePriceGross%7Casc&pageNumber=5&pageSize=20&purchaseOption=sale&reservationLabels=available> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 126506
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 126506: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 129488
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 129488: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 128789
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 128789: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 127200
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 127200: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 126152
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 126152: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 126502
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 126502: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 124948
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 124948: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 129596
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 129596: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 126620
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 126620: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 124002
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 124002: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 129582
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 129582: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 126155
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 126155: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 128781
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 128781: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 127040
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 127040: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 128151
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 128151: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 121431
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 121431: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 129479
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 129479: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 130276
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 130276: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 128927
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 128927: 1
2026-03-12 19:55:42 [arval.uk] INFO: Found listing with ID: 123932
2026-03-12 19:55:42 [arval.uk] INFO: Scrape type for 123932: 1
2026-03-12 19:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121766)
2026-03-12 19:55:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677ebc90>
2026-03-12 19:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/9.jpeg saved to cache
2026-03-12 19:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208
2026-03-12 19:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121766)
2026-03-12 19:55:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6608e3d0>
2026-03-12 19:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/8.jpeg saved to cache
2026-03-12 19:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208
2026-03-12 19:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3?orderBy=salePriceGross%7Casc&pageNumber=6&pageSize=20&purchaseOption=sale&reservationLabels=available> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:44 [arval.uk] INFO: Found listing with ID: 124544
2026-03-12 19:55:44 [arval.uk] INFO: Scrape type for 124544: 1
2026-03-12 19:55:44 [arval.uk] INFO: Found listing with ID: 126261
2026-03-12 19:55:44 [arval.uk] INFO: Scrape type for 126261: 1
2026-03-12 19:55:44 [arval.uk] INFO: Found listing with ID: 127174
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 127174: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 124959
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 124959: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 127060
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 127060: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 124133
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 124133: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 124732
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 124732: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 126956
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 126956: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 129580
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 129580: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 120780
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 120780: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 124008
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 124008: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 124960
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 124960: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 127328
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 127328: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 128930
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 128930: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 124952
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 124952: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 124962
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 124962: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 121355
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 121355: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 126268
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 126268: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 123711
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 123711: 1
2026-03-12 19:55:45 [arval.uk] INFO: Found listing with ID: 123496
2026-03-12 19:55:45 [arval.uk] INFO: Scrape type for 123496: 1
2026-03-12 19:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127057)
2026-03-12 19:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6608fe90>
2026-03-12 19:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/9.jpeg saved to cache
2026-03-12 19:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687
2026-03-12 19:55:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127057)
2026-03-12 19:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676308d0>
2026-03-12 19:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/8.jpeg saved to cache
2026-03-12 19:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687
2026-03-12 19:55:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128927> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 226403f3-1b7e-547f-a87a-e210532579d6 with identifier: 128927
2026-03-12 19:55:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 226403f3-1b7e-547f-a87a-e210532579d6 with scrape type 1
2026-03-12 19:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 226403f3-1b7e-547f-a87a-e210532579d6
2026-03-12 19:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/0.jpeg not downloaded yet
2026-03-12 19:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113137)
2026-03-12 19:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/1.jpeg not downloaded yet
2026-03-12 19:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/2.jpeg not downloaded yet
2026-03-12 19:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/3.jpeg not downloaded yet
2026-03-12 19:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/4.jpeg not downloaded yet
2026-03-12 19:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/5.jpeg not downloaded yet
2026-03-12 19:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/6.jpeg not downloaded yet
2026-03-12 19:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/7.jpeg not downloaded yet
2026-03-12 19:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/8.jpeg not downloaded yet
2026-03-12 19:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66080350>
2026-03-12 19:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/9.jpeg saved to cache
2026-03-12 19:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 78f95676-02ed-5666-b076-efe227a54063
2026-03-12 19:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/9.jpeg not downloaded yet
2026-03-12 19:55:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113137)
2026-03-12 19:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f543d0>
2026-03-12 19:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/8.jpeg saved to cache
2026-03-12 19:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 78f95676-02ed-5666-b076-efe227a54063
2026-03-12 19:55:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3?orderBy=salePriceGross%7Casc&pageNumber=7&pageSize=20&purchaseOption=sale&reservationLabels=available> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 127955
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 127955: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 127914
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 127914: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 127511
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 127511: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 123714
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 123714: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 130271
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 130271: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 127035
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 127035: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 129478
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 129478: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 116271
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 116271: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 128788
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 128788: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 111513
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 111513: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 120953
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 120953: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 124651
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 124651: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 123495
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 123495: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 126501
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 126501: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 117221
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 117221: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 122780
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 122780: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 127304
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 127304: 1
2026-03-12 19:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113137)
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 128152
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 128152: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 128078
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 128078: 1
2026-03-12 19:55:49 [arval.uk] INFO: Found listing with ID: 118274
2026-03-12 19:55:49 [arval.uk] INFO: Scrape type for 118274: 1
2026-03-12 19:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66040d50>
2026-03-12 19:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/7.jpeg saved to cache
2026-03-12 19:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78f95676-02ed-5666-b076-efe227a54063
2026-03-12 19:55:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114728)
2026-03-12 19:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6761f610>
2026-03-12 19:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/9.jpeg saved to cache
2026-03-12 19:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c4a088e-9921-5709-9e94-3706151351d9
2026-03-12 19:55:51 [scrapy.extensions.logstats] INFO: Crawled 28 pages (at 28 pages/min), scraped 0 items (at 0 items/min)
2026-03-12 19:55:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-12 19:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114728)
2026-03-12 19:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123496> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713e510>
2026-03-12 19:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/8.jpeg saved to cache
2026-03-12 19:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c4a088e-9921-5709-9e94-3706151351d9
2026-03-12 19:55:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2807c090-c73d-5930-9d2e-1f3ae2901bf1 with identifier: 123496
2026-03-12 19:55:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1 with scrape type 1
2026-03-12 19:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1
2026-03-12 19:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/0.jpeg not downloaded yet
2026-03-12 19:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/1.jpeg not downloaded yet
2026-03-12 19:55:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/2.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/3.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/4.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/5.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/6.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/7.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/8.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/9.jpeg not downloaded yet
2026-03-12 19:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127304> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12661ac9-5641-5f42-bfc8-bfbf15fb65ac with identifier: 127304
2026-03-12 19:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac with scrape type 1
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/0.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/1.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/2.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/3.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/4.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/5.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/6.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/7.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/8.jpeg not downloaded yet
2026-03-12 19:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/9.jpeg not downloaded yet
2026-03-12 19:55:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114728)
2026-03-12 19:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f3a8d0>
2026-03-12 19:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/7.jpeg saved to cache
2026-03-12 19:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c4a088e-9921-5709-9e94-3706151351d9
2026-03-12 19:55:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114728)
2026-03-12 19:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67198a90>
2026-03-12 19:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/6.jpeg saved to cache
2026-03-12 19:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c4a088e-9921-5709-9e94-3706151351d9
2026-03-12 19:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123932> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1697f7c1-068d-5074-b14f-18e7c10d60ed with identifier: 123932
2026-03-12 19:55:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1697f7c1-068d-5074-b14f-18e7c10d60ed with scrape type 1
2026-03-12 19:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1697f7c1-068d-5074-b14f-18e7c10d60ed
2026-03-12 19:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/0.jpeg not downloaded yet
2026-03-12 19:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/1.jpeg not downloaded yet
2026-03-12 19:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/2.jpeg not downloaded yet
2026-03-12 19:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/3.jpeg not downloaded yet
2026-03-12 19:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/4.jpeg not downloaded yet
2026-03-12 19:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/5.jpeg not downloaded yet
2026-03-12 19:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/6.jpeg not downloaded yet
2026-03-12 19:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/7.jpeg not downloaded yet
2026-03-12 19:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/8.jpeg not downloaded yet
2026-03-12 19:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/9.jpeg not downloaded yet
2026-03-12 19:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3?orderBy=salePriceGross%7Casc&pageNumber=8&pageSize=20&purchaseOption=sale&reservationLabels=available> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:55 [arval.uk] INFO: Found listing with ID: 128783
2026-03-12 19:55:55 [arval.uk] INFO: Scrape type for 128783: 1
2026-03-12 19:55:55 [arval.uk] INFO: Found listing with ID: 124639
2026-03-12 19:55:55 [arval.uk] INFO: Scrape type for 124639: 1
2026-03-12 19:55:55 [arval.uk] INFO: Found listing with ID: 122954
2026-03-12 19:55:55 [arval.uk] INFO: Scrape type for 122954: 1
2026-03-12 19:55:55 [arval.uk] INFO: Found listing with ID: 129377
2026-03-12 19:55:55 [arval.uk] INFO: Scrape type for 129377: 1
2026-03-12 19:55:55 [arval.uk] INFO: Found listing with ID: 128928
2026-03-12 19:55:55 [arval.uk] INFO: Scrape type for 128928: 1
2026-03-12 19:55:55 [arval.uk] INFO: Found listing with ID: 124006
2026-03-12 19:55:55 [arval.uk] INFO: Scrape type for 124006: 1
2026-03-12 19:55:55 [arval.uk] INFO: Found listing with ID: 128902
2026-03-12 19:55:55 [arval.uk] INFO: Scrape type for 128902: 1
2026-03-12 19:55:55 [arval.uk] INFO: Found listing with ID: 128726
2026-03-12 19:55:55 [arval.uk] INFO: Scrape type for 128726: 1
2026-03-12 19:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114728)
2026-03-12 19:55:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f58250>
2026-03-12 19:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/5.jpeg saved to cache
2026-03-12 19:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c4a088e-9921-5709-9e94-3706151351d9
2026-03-12 19:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128078> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 486a0a2a-49b0-5c49-bce6-67a95933bc2c with identifier: 128078
2026-03-12 19:55:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c with scrape type 1
2026-03-12 19:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c
2026-03-12 19:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/0.jpeg not downloaded yet
2026-03-12 19:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/1.jpeg not downloaded yet
2026-03-12 19:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/2.jpeg not downloaded yet
2026-03-12 19:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/3.jpeg not downloaded yet
2026-03-12 19:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/4.jpeg not downloaded yet
2026-03-12 19:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/5.jpeg not downloaded yet
2026-03-12 19:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/6.jpeg not downloaded yet
2026-03-12 19:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/7.jpeg not downloaded yet
2026-03-12 19:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/8.jpeg not downloaded yet
2026-03-12 19:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/9.jpeg not downloaded yet
2026-03-12 19:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118274> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec20d84d-0d4f-557b-aa07-ab75019f128b with identifier: 118274
2026-03-12 19:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec20d84d-0d4f-557b-aa07-ab75019f128b with scrape type 1
2026-03-12 19:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec20d84d-0d4f-557b-aa07-ab75019f128b
2026-03-12 19:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/0.jpeg not downloaded yet
2026-03-12 19:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/1.jpeg not downloaded yet
2026-03-12 19:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/2.jpeg not downloaded yet
2026-03-12 19:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/3.jpeg not downloaded yet
2026-03-12 19:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/4.jpeg not downloaded yet
2026-03-12 19:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/5.jpeg not downloaded yet
2026-03-12 19:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/6.jpeg not downloaded yet
2026-03-12 19:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/7.jpeg not downloaded yet
2026-03-12 19:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/8.jpeg not downloaded yet
2026-03-12 19:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/9.jpeg not downloaded yet
2026-03-12 19:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114728)
2026-03-12 19:55:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6608db90>
2026-03-12 19:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/4.jpeg saved to cache
2026-03-12 19:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c4a088e-9921-5709-9e94-3706151351d9
2026-03-12 19:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3?orderBy=salePriceGross%7Casc&pageNumber=9&pageSize=20&purchaseOption=sale&reservationLabels=available> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114728)
2026-03-12 19:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123711> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a9b90>
2026-03-12 19:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/3.jpeg saved to cache
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c4a088e-9921-5709-9e94-3706151351d9
2026-03-12 19:55:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80b22762-6a8f-55c9-9b8d-d93074799564 with identifier: 123711
2026-03-12 19:55:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80b22762-6a8f-55c9-9b8d-d93074799564 with scrape type 1
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80b22762-6a8f-55c9-9b8d-d93074799564
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/0.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/1.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/2.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/3.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/4.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/5.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/6.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/7.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/8.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/9.jpeg not downloaded yet
2026-03-12 19:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128726> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:55:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c2f849a-f888-53e8-b32a-0fc37f78d555 with identifier: 128726
2026-03-12 19:55:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c2f849a-f888-53e8-b32a-0fc37f78d555 with scrape type 1
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c2f849a-f888-53e8-b32a-0fc37f78d555
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/0.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/1.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/2.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/3.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/4.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/5.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/6.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/7.jpeg not downloaded yet
2026-03-12 19:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/8.jpeg not downloaded yet
2026-03-12 19:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/9.jpeg not downloaded yet
2026-03-12 19:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114728)
2026-03-12 19:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67772810>
2026-03-12 19:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/2.jpeg saved to cache
2026-03-12 19:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c4a088e-9921-5709-9e94-3706151351d9
2026-03-12 19:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118271)
2026-03-12 19:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f97050>
2026-03-12 19:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/9.jpeg saved to cache
2026-03-12 19:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29f554a8-753f-5367-a09c-a71edb76efe3
2026-03-12 19:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128927)
2026-03-12 19:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f35f50>
2026-03-12 19:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/0.jpeg saved to cache
2026-03-12 19:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 226403f3-1b7e-547f-a87a-e210532579d6
2026-03-12 19:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128927)
2026-03-12 19:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67753ad0>
2026-03-12 19:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/9.jpeg saved to cache
2026-03-12 19:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 226403f3-1b7e-547f-a87a-e210532579d6
2026-03-12 19:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128927)
2026-03-12 19:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6ceb8250>
2026-03-12 19:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/8.jpeg saved to cache
2026-03-12 19:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 226403f3-1b7e-547f-a87a-e210532579d6
2026-03-12 19:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123496)
2026-03-12 19:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677e8810>
2026-03-12 19:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/9.jpeg saved to cache
2026-03-12 19:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1
2026-03-12 19:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127304)
2026-03-12 19:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66029f50>
2026-03-12 19:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/9.jpeg saved to cache
2026-03-12 19:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac
2026-03-12 19:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127304)
2026-03-12 19:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedb010>
2026-03-12 19:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/8.jpeg saved to cache
2026-03-12 19:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac
2026-03-12 19:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127304)
2026-03-12 19:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67780710>
2026-03-12 19:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/7.jpeg saved to cache
2026-03-12 19:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac
2026-03-12 19:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123932)
2026-03-12 19:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67128f10>
2026-03-12 19:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/9.jpeg saved to cache
2026-03-12 19:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1697f7c1-068d-5074-b14f-18e7c10d60ed
2026-03-12 19:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128078)
2026-03-12 19:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66024b50>
2026-03-12 19:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/9.jpeg saved to cache
2026-03-12 19:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c
2026-03-12 19:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118274)
2026-03-12 19:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb3e50>
2026-03-12 19:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/9.jpeg saved to cache
2026-03-12 19:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec20d84d-0d4f-557b-aa07-ab75019f128b
2026-03-12 19:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118274)
2026-03-12 19:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0af190>
2026-03-12 19:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/8.jpeg saved to cache
2026-03-12 19:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec20d84d-0d4f-557b-aa07-ab75019f128b
2026-03-12 19:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118274)
2026-03-12 19:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb61d0>
2026-03-12 19:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/7.jpeg saved to cache
2026-03-12 19:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec20d84d-0d4f-557b-aa07-ab75019f128b
2026-03-12 19:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118274)
2026-03-12 19:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67680690>
2026-03-12 19:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/6.jpeg saved to cache
2026-03-12 19:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec20d84d-0d4f-557b-aa07-ab75019f128b
2026-03-12 19:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123711)
2026-03-12 19:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717ae50>
2026-03-12 19:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/9.jpeg saved to cache
2026-03-12 19:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80b22762-6a8f-55c9-9b8d-d93074799564
2026-03-12 19:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128726)
2026-03-12 19:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763b510>
2026-03-12 19:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/9.jpeg saved to cache
2026-03-12 19:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c2f849a-f888-53e8-b32a-0fc37f78d555
2026-03-12 19:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128726)
2026-03-12 19:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18f450>
2026-03-12 19:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/8.jpeg saved to cache
2026-03-12 19:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c2f849a-f888-53e8-b32a-0fc37f78d555
2026-03-12 19:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128726)
2026-03-12 19:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b6dd0>
2026-03-12 19:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/7.jpeg saved to cache
2026-03-12 19:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c2f849a-f888-53e8-b32a-0fc37f78d555
2026-03-12 19:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128726)
2026-03-12 19:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb3ed0>
2026-03-12 19:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/6.jpeg saved to cache
2026-03-12 19:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c2f849a-f888-53e8-b32a-0fc37f78d555
2026-03-12 19:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128726)
2026-03-12 19:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67145410>
2026-03-12 19:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/5.jpeg saved to cache
2026-03-12 19:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c2f849a-f888-53e8-b32a-0fc37f78d555
2026-03-12 19:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128726)
2026-03-12 19:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f55350>
2026-03-12 19:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/4.jpeg saved to cache
2026-03-12 19:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c2f849a-f888-53e8-b32a-0fc37f78d555
2026-03-12 19:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128726)
2026-03-12 19:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67121450>
2026-03-12 19:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/3.jpeg saved to cache
2026-03-12 19:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c2f849a-f888-53e8-b32a-0fc37f78d555
2026-03-12 19:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128726)
2026-03-12 19:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb1a50>
2026-03-12 19:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/2.jpeg saved to cache
2026-03-12 19:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c2f849a-f888-53e8-b32a-0fc37f78d555
2026-03-12 19:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128726)
2026-03-12 19:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a85d0>
2026-03-12 19:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/1.jpeg saved to cache
2026-03-12 19:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c2f849a-f888-53e8-b32a-0fc37f78d555
2026-03-12 19:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128726)
2026-03-12 19:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f8d5d0>
2026-03-12 19:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/0.jpeg saved to cache
2026-03-12 19:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c2f849a-f888-53e8-b32a-0fc37f78d555
2026-03-12 19:56:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c2f849a-f888-53e8-b32a-0fc37f78d555, skipping ID generation
2026-03-12 19:56:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c2f849a-f888-53e8-b32a-0fc37f78d555 with scrape type 1
2026-03-12 19:56:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c2f849a-f888-53e8-b32a-0fc37f78d555 sending to next pipeline
2026-03-12 19:56:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 0c2f849a-f888-53e8-b32a-0fc37f78d555, identifier: 128726
2026-03-12 19:56:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 0c2f849a-f888-53e8-b32a-0fc37f78d555 with identifier: 128726
2026-03-12 19:56:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 19:56:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 19:56:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 0c2f849a-f888-53e8-b32a-0fc37f78d555 with identifier: 128726
2026-03-12 19:56:32 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 0c2f849a-f888-53e8-b32a-0fc37f78d555 with identifier: 128726 to the API
2026-03-12 19:56:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:56:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:56:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.9L',
'engine_horse_power': 234,
'expiration_date': None,
'fuel_type': 'Diesel',
'id': '0c2f849a-f888-53e8-b32a-0fc37f78d555',
'is_damaged': False,
'is_operable': True,
'license_plate': 'LS23ECZ',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/mercedes-v-class-diesel-estate-2019-v300-d-237-amg-line-5dr-9g-tronic-extra-long-128726',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Mercedes',
'model': 'V CLASS DIESEL ESTATE (2019)',
'odometer': 13472,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75136,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62268,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79041,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67047,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69484,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69762,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68047,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54385,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73717,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c2f849a-f888-53e8-b32a-0fc37f78d555/0c2f849a-f888-53e8-b32a-0fc37f78d555_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86486,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128726/9.jpeg',
'Width': 800}],
'price': 54500.0,
'price_includes_vat': True,
'registration_date': '2023-03-14',
'seats_number': 8,
'seller_name': None,
'title': 'Mercedes V CLASS DIESEL ESTATE (2019) V300 d 237 AMG Line 5dr '
'9G-Tronic [Extra Long]',
'transmission': 'automatic',
'trim': 'V300 d 237 AMG Line 5dr 9G-Tronic [Extra Long]',
'vin': 'W1VVNLFZ8P4193797',
'year': 2023}
2026-03-12 19:56:32 [arval.uk] INFO: Saving data for 128726: {'created_time': 1773345392.581704, 'last_price_update_time': 1773345392.581715}
2026-03-12 19:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123711)
2026-03-12 19:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedc0d0>
2026-03-12 19:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/8.jpeg saved to cache
2026-03-12 19:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80b22762-6a8f-55c9-9b8d-d93074799564
2026-03-12 19:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123711)
2026-03-12 19:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a8050>
2026-03-12 19:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/7.jpeg saved to cache
2026-03-12 19:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80b22762-6a8f-55c9-9b8d-d93074799564
2026-03-12 19:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123711)
2026-03-12 19:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18d190>
2026-03-12 19:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/6.jpeg saved to cache
2026-03-12 19:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80b22762-6a8f-55c9-9b8d-d93074799564
2026-03-12 19:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123711)
2026-03-12 19:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb3c90>
2026-03-12 19:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/5.jpeg saved to cache
2026-03-12 19:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80b22762-6a8f-55c9-9b8d-d93074799564
2026-03-12 19:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123711)
2026-03-12 19:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607a910>
2026-03-12 19:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/4.jpeg saved to cache
2026-03-12 19:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80b22762-6a8f-55c9-9b8d-d93074799564
2026-03-12 19:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123711)
2026-03-12 19:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb0490>
2026-03-12 19:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/3.jpeg saved to cache
2026-03-12 19:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80b22762-6a8f-55c9-9b8d-d93074799564
2026-03-12 19:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123711)
2026-03-12 19:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67144550>
2026-03-12 19:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/2.jpeg saved to cache
2026-03-12 19:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80b22762-6a8f-55c9-9b8d-d93074799564
2026-03-12 19:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123711)
2026-03-12 19:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766efd0>
2026-03-12 19:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/1.jpeg saved to cache
2026-03-12 19:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80b22762-6a8f-55c9-9b8d-d93074799564
2026-03-12 19:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123711)
2026-03-12 19:56:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712ded0>
2026-03-12 19:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/0.jpeg saved to cache
2026-03-12 19:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80b22762-6a8f-55c9-9b8d-d93074799564
2026-03-12 19:56:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80b22762-6a8f-55c9-9b8d-d93074799564, skipping ID generation
2026-03-12 19:56:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80b22762-6a8f-55c9-9b8d-d93074799564 with scrape type 1
2026-03-12 19:56:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80b22762-6a8f-55c9-9b8d-d93074799564 sending to next pipeline
2026-03-12 19:56:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 80b22762-6a8f-55c9-9b8d-d93074799564, identifier: 123711
2026-03-12 19:56:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 80b22762-6a8f-55c9-9b8d-d93074799564 with identifier: 123711
2026-03-12 19:56:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 19:56:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 19:56:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 80b22762-6a8f-55c9-9b8d-d93074799564 with identifier: 123711
2026-03-12 19:56:43 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 80b22762-6a8f-55c9-9b8d-d93074799564 with identifier: 123711 to the API
2026-03-12 19:56:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:56:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:56:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 226,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': '80b22762-6a8f-55c9-9b8d-d93074799564',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BK72EEP',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/kia-sportage-estate-2021-16t-gdi-hev-gt-line-s-5dr-auto-123711',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Kia',
'model': 'SPORTAGE ESTATE (2021)',
'odometer': 27522,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51442,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52568,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50626,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44981,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50790,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52618,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51754,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48554,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100306,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80b22762-6a8f-55c9-9b8d-d93074799564/80b22762-6a8f-55c9-9b8d-d93074799564_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42565,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123711/9.jpeg',
'Width': 800}],
'price': 23600.0,
'price_includes_vat': True,
'registration_date': '2022-10-20',
'seats_number': 5,
'seller_name': None,
'title': 'Kia SPORTAGE ESTATE (2021) 1.6T GDi HEV GT-Line S 5dr Auto',
'transmission': 'automatic',
'trim': '1.6T GDi HEV GT-Line S 5dr Auto',
'vin': 'U5YPX81GMNL041867',
'year': 2022}
2026-03-12 19:56:43 [arval.uk] INFO: Saving data for 123711: {'created_time': 1773345403.949129, 'last_price_update_time': 1773345403.949141}
2026-03-12 19:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118274)
2026-03-12 19:56:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766c910>
2026-03-12 19:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/5.jpeg saved to cache
2026-03-12 19:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec20d84d-0d4f-557b-aa07-ab75019f128b
2026-03-12 19:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118274)
2026-03-12 19:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660782d0>
2026-03-12 19:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/4.jpeg saved to cache
2026-03-12 19:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec20d84d-0d4f-557b-aa07-ab75019f128b
2026-03-12 19:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124006> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:56:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 623097f6-9a15-5819-8438-4d5ee439cbf6 with identifier: 124006
2026-03-12 19:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 623097f6-9a15-5819-8438-4d5ee439cbf6 with scrape type 1
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 623097f6-9a15-5819-8438-4d5ee439cbf6
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/0.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/1.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/2.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/3.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/4.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/5.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/6.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/7.jpeg not downloaded yet
2026-03-12 19:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128902> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/8.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/9.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380 with identifier: 128902
2026-03-12 19:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380 with scrape type 1
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/0.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/1.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/2.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/3.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/4.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/5.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/6.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/7.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/8.jpeg not downloaded yet
2026-03-12 19:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/9.jpeg not downloaded yet
2026-03-12 19:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118274)
2026-03-12 19:56:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766f410>
2026-03-12 19:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/3.jpeg saved to cache
2026-03-12 19:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec20d84d-0d4f-557b-aa07-ab75019f128b
2026-03-12 19:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118274)
2026-03-12 19:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16e3d0>
2026-03-12 19:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/2.jpeg saved to cache
2026-03-12 19:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec20d84d-0d4f-557b-aa07-ab75019f128b
2026-03-12 19:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129377> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:56:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3129b5ad-0e1a-5bc9-a083-ead381e58f12 with identifier: 129377
2026-03-12 19:56:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12 with scrape type 1
2026-03-12 19:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12
2026-03-12 19:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/0.jpeg not downloaded yet
2026-03-12 19:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/1.jpeg not downloaded yet
2026-03-12 19:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/2.jpeg not downloaded yet
2026-03-12 19:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/3.jpeg not downloaded yet
2026-03-12 19:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/4.jpeg not downloaded yet
2026-03-12 19:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/5.jpeg not downloaded yet
2026-03-12 19:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/6.jpeg not downloaded yet
2026-03-12 19:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/7.jpeg not downloaded yet
2026-03-12 19:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/8.jpeg not downloaded yet
2026-03-12 19:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/9.jpeg not downloaded yet
2026-03-12 19:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118274)
2026-03-12 19:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b70d0>
2026-03-12 19:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/1.jpeg saved to cache
2026-03-12 19:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec20d84d-0d4f-557b-aa07-ab75019f128b
2026-03-12 19:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128928> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:56:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2740f3f7-edb4-5916-bd7a-c220d6e2d738 with identifier: 128928
2026-03-12 19:56:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738 with scrape type 1
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/0.jpeg not downloaded yet
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/1.jpeg not downloaded yet
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/2.jpeg not downloaded yet
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/3.jpeg not downloaded yet
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/4.jpeg not downloaded yet
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/5.jpeg not downloaded yet
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/6.jpeg not downloaded yet
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/7.jpeg not downloaded yet
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/8.jpeg not downloaded yet
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/9.jpeg not downloaded yet
2026-03-12 19:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118274)
2026-03-12 19:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0dd490>
2026-03-12 19:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/0.jpeg saved to cache
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec20d84d-0d4f-557b-aa07-ab75019f128b
2026-03-12 19:56:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec20d84d-0d4f-557b-aa07-ab75019f128b, skipping ID generation
2026-03-12 19:56:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec20d84d-0d4f-557b-aa07-ab75019f128b with scrape type 1
2026-03-12 19:56:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec20d84d-0d4f-557b-aa07-ab75019f128b sending to next pipeline
2026-03-12 19:56:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: ec20d84d-0d4f-557b-aa07-ab75019f128b, identifier: 118274
2026-03-12 19:56:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: ec20d84d-0d4f-557b-aa07-ab75019f128b with identifier: 118274
2026-03-12 19:56:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 19:56:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: ec20d84d-0d4f-557b-aa07-ab75019f128b with identifier: 118274
2026-03-12 19:56:50 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: ec20d84d-0d4f-557b-aa07-ab75019f128b with identifier: 118274 to the API
2026-03-12 19:56:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:56:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 315,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'ec20d84d-0d4f-557b-aa07-ab75019f128b',
'is_damaged': False,
'is_operable': True,
'license_plate': 'MT73AHC',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-20-tsi-320-r-4motion-5dr-dsg-118274',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 21688,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 45,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77941,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63800,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81143,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58881,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65569,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91678,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75904,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63565,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 13271,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec20d84d-0d4f-557b-aa07-ab75019f128b/ec20d84d-0d4f-557b-aa07-ab75019f128b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36857,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118274/9.jpeg',
'Width': 800}],
'price': 30200.0,
'price_includes_vat': True,
'registration_date': '2023-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 2.0 TSI 320 R 4Motion 5dr DSG',
'transmission': 'automatic',
'trim': '2.0 TSI 320 R 4Motion 5dr DSG',
'vin': 'WVWZZZCD9RW121801',
'year': 2023}
2026-03-12 19:56:51 [arval.uk] INFO: Saving data for 118274: {'created_time': 1773345411.136617, 'last_price_update_time': 1773345411.136626}
2026-03-12 19:56:51 [scrapy.extensions.logstats] INFO: Crawled 41 pages (at 13 pages/min), scraped 3 items (at 3 items/min)
2026-03-12 19:56:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 19:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128078)
2026-03-12 19:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbddc90>
2026-03-12 19:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/8.jpeg saved to cache
2026-03-12 19:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c
2026-03-12 19:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128078)
2026-03-12 19:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16d690>
2026-03-12 19:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/7.jpeg saved to cache
2026-03-12 19:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c
2026-03-12 19:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128078)
2026-03-12 19:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b5990>
2026-03-12 19:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/6.jpeg saved to cache
2026-03-12 19:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c
2026-03-12 19:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128078)
2026-03-12 19:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbddc50>
2026-03-12 19:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/5.jpeg saved to cache
2026-03-12 19:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c
2026-03-12 19:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128078)
2026-03-12 19:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b5e10>
2026-03-12 19:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/4.jpeg saved to cache
2026-03-12 19:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c
2026-03-12 19:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128078)
2026-03-12 19:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a10d0>
2026-03-12 19:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/3.jpeg saved to cache
2026-03-12 19:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c
2026-03-12 19:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128078)
2026-03-12 19:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1cd50>
2026-03-12 19:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/2.jpeg saved to cache
2026-03-12 19:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c
2026-03-12 19:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128078)
2026-03-12 19:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16cd50>
2026-03-12 19:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/1.jpeg saved to cache
2026-03-12 19:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c
2026-03-12 19:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128078)
2026-03-12 19:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b7d10>
2026-03-12 19:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/0.jpeg saved to cache
2026-03-12 19:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c
2026-03-12 19:57:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 486a0a2a-49b0-5c49-bce6-67a95933bc2c, skipping ID generation
2026-03-12 19:57:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c with scrape type 1
2026-03-12 19:57:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 486a0a2a-49b0-5c49-bce6-67a95933bc2c sending to next pipeline
2026-03-12 19:57:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 486a0a2a-49b0-5c49-bce6-67a95933bc2c, identifier: 128078
2026-03-12 19:57:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 486a0a2a-49b0-5c49-bce6-67a95933bc2c with identifier: 128078
2026-03-12 19:57:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 19:57:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 486a0a2a-49b0-5c49-bce6-67a95933bc2c with identifier: 128078
2026-03-12 19:57:02 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 486a0a2a-49b0-5c49-bce6-67a95933bc2c with identifier: 128078 to the API
2026-03-12 19:57:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:57:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:57:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 383,
'expiration_date': None,
'fuel_type': 'Electric',
'id': '486a0a2a-49b0-5c49-bce6-67a95933bc2c',
'is_damaged': False,
'is_operable': True,
'license_plate': 'WP72LYO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/tesla-model-y-hatchback-2021-long-range-awd-5dr-auto-128078',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Tesla',
'model': 'MODEL Y HATCHBACK (2021)',
'odometer': 5123,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51146,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38923,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51140,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52974,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52036,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38371,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51845,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51286,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40763,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_486a0a2a-49b0-5c49-bce6-67a95933bc2c/486a0a2a-49b0-5c49-bce6-67a95933bc2c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36265,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128078/9.jpeg',
'Width': 800}],
'price': 28700.0,
'price_includes_vat': True,
'registration_date': '2022-12-01',
'seats_number': 5,
'seller_name': None,
'title': 'Tesla MODEL Y HATCHBACK (2021) Long Range AWD 5dr Auto',
'transmission': 'automatic',
'trim': 'Long Range AWD 5dr Auto',
'vin': 'LRWYHCEK4PC560424',
'year': 2022}
2026-03-12 19:57:02 [arval.uk] INFO: Saving data for 128078: {'created_time': 1773345422.645113, 'last_price_update_time': 1773345422.645123}
2026-03-12 19:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124006)
2026-03-12 19:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb7910>
2026-03-12 19:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/7.jpeg saved to cache
2026-03-12 19:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 623097f6-9a15-5819-8438-4d5ee439cbf6
2026-03-12 19:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128902)
2026-03-12 19:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b5850>
2026-03-12 19:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/9.jpeg saved to cache
2026-03-12 19:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380
2026-03-12 19:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128902)
2026-03-12 19:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67606610>
2026-03-12 19:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/8.jpeg saved to cache
2026-03-12 19:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380
2026-03-12 19:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128902)
2026-03-12 19:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16eb90>
2026-03-12 19:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/7.jpeg saved to cache
2026-03-12 19:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380
2026-03-12 19:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129377)
2026-03-12 19:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb2850>
2026-03-12 19:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/9.jpeg saved to cache
2026-03-12 19:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12
2026-03-12 19:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129377)
2026-03-12 19:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67771390>
2026-03-12 19:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/8.jpeg saved to cache
2026-03-12 19:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12
2026-03-12 19:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128928)
2026-03-12 19:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1d350>
2026-03-12 19:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/9.jpeg saved to cache
2026-03-12 19:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738
2026-03-12 19:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128928)
2026-03-12 19:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18e210>
2026-03-12 19:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/8.jpeg saved to cache
2026-03-12 19:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738
2026-03-12 19:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128928)
2026-03-12 19:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb2a10>
2026-03-12 19:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/7.jpeg saved to cache
2026-03-12 19:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738
2026-03-12 19:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128928)
2026-03-12 19:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67639010>
2026-03-12 19:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/6.jpeg saved to cache
2026-03-12 19:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738
2026-03-12 19:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128928)
2026-03-12 19:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb36d0>
2026-03-12 19:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/5.jpeg saved to cache
2026-03-12 19:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738
2026-03-12 19:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128928)
2026-03-12 19:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbec8d0>
2026-03-12 19:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/4.jpeg saved to cache
2026-03-12 19:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738
2026-03-12 19:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128928)
2026-03-12 19:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67707e10>
2026-03-12 19:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/3.jpeg saved to cache
2026-03-12 19:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738
2026-03-12 19:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128928)
2026-03-12 19:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7aed0>
2026-03-12 19:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/2.jpeg saved to cache
2026-03-12 19:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738
2026-03-12 19:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128928)
2026-03-12 19:57:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604f790>
2026-03-12 19:57:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/1.jpeg saved to cache
2026-03-12 19:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738
2026-03-12 19:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128928)
2026-03-12 19:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f8150>
2026-03-12 19:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/0.jpeg saved to cache
2026-03-12 19:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738
2026-03-12 19:57:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2740f3f7-edb4-5916-bd7a-c220d6e2d738, skipping ID generation
2026-03-12 19:57:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738 with scrape type 1
2026-03-12 19:57:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2740f3f7-edb4-5916-bd7a-c220d6e2d738 sending to next pipeline
2026-03-12 19:57:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 2740f3f7-edb4-5916-bd7a-c220d6e2d738, identifier: 128928
2026-03-12 19:57:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 2740f3f7-edb4-5916-bd7a-c220d6e2d738 with identifier: 128928
2026-03-12 19:57:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 19:57:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 2740f3f7-edb4-5916-bd7a-c220d6e2d738 with identifier: 128928
2026-03-12 19:57:20 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 2740f3f7-edb4-5916-bd7a-c220d6e2d738 with identifier: 128928 to the API
2026-03-12 19:57:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:57:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '0.0L',
'engine_horse_power': 469,
'expiration_date': None,
'fuel_type': 'Electric',
'id': '2740f3f7-edb4-5916-bd7a-c220d6e2d738',
'is_damaged': False,
'is_operable': True,
'license_plate': 'AV72YLX',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-e-tron-gt-saloon-2021-390kw-quattro-93kwh-4dr-auto-128928',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'E-TRON GT SALOON (2021)',
'odometer': 19748,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78835,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80477,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91971,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90620,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93557,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89288,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85429,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107670,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73777,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2740f3f7-edb4-5916-bd7a-c220d6e2d738/2740f3f7-edb4-5916-bd7a-c220d6e2d738_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71567,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128928/9.jpeg',
'Width': 800}],
'price': 37300.0,
'price_includes_vat': True,
'registration_date': '2022-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Audi E-TRON GT SALOON (2021) 390kW Quattro 93kWh 4dr Auto',
'transmission': 'automatic',
'trim': '390kW Quattro 93kWh 4dr Auto',
'vin': 'WAUZZZFW1P7000388',
'year': 2022}
2026-03-12 19:57:20 [arval.uk] INFO: Saving data for 128928: {'created_time': 1773345440.945588, 'last_price_update_time': 1773345440.9456}
2026-03-12 19:57:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129377)
2026-03-12 19:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f8cb50>
2026-03-12 19:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/7.jpeg saved to cache
2026-03-12 19:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12
2026-03-12 19:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129377)
2026-03-12 19:57:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66051ed0>
2026-03-12 19:57:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/6.jpeg saved to cache
2026-03-12 19:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12
2026-03-12 19:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129377)
2026-03-12 19:57:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cfb3190>
2026-03-12 19:57:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/5.jpeg saved to cache
2026-03-12 19:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12
2026-03-12 19:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129377)
2026-03-12 19:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f78dd0>
2026-03-12 19:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/4.jpeg saved to cache
2026-03-12 19:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12
2026-03-12 19:57:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129377)
2026-03-12 19:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18c7d0>
2026-03-12 19:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/3.jpeg saved to cache
2026-03-12 19:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12
2026-03-12 19:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129377)
2026-03-12 19:57:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67647c90>
2026-03-12 19:57:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/2.jpeg saved to cache
2026-03-12 19:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12
2026-03-12 19:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129377)
2026-03-12 19:57:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67633bd0>
2026-03-12 19:57:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/1.jpeg saved to cache
2026-03-12 19:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12
2026-03-12 19:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129377)
2026-03-12 19:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676463d0>
2026-03-12 19:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/0.jpeg saved to cache
2026-03-12 19:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12
2026-03-12 19:57:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3129b5ad-0e1a-5bc9-a083-ead381e58f12, skipping ID generation
2026-03-12 19:57:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12 with scrape type 1
2026-03-12 19:57:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3129b5ad-0e1a-5bc9-a083-ead381e58f12 sending to next pipeline
2026-03-12 19:57:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 3129b5ad-0e1a-5bc9-a083-ead381e58f12, identifier: 129377
2026-03-12 19:57:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 3129b5ad-0e1a-5bc9-a083-ead381e58f12 with identifier: 129377
2026-03-12 19:57:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 3129b5ad-0e1a-5bc9-a083-ead381e58f12 with identifier: 129377
2026-03-12 19:57:30 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 3129b5ad-0e1a-5bc9-a083-ead381e58f12 with identifier: 129377 to the API
2026-03-12 19:57:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:57:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:57:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 315,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '3129b5ad-0e1a-5bc9-a083-ead381e58f12',
'is_damaged': False,
'is_operable': True,
'license_plate': 'WP73SYO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-20-tsi-320-r-4motion-5dr-dsg-129377',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 10074,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85855,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69398,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87620,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78894,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72929,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73332,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79481,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76365,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61941,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3129b5ad-0e1a-5bc9-a083-ead381e58f12/3129b5ad-0e1a-5bc9-a083-ead381e58f12_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92210,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129377/9.jpeg',
'Width': 800}],
'price': 32100.0,
'price_includes_vat': True,
'registration_date': '2023-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 2.0 TSI 320 R 4Motion 5dr DSG',
'transmission': 'automatic',
'trim': '2.0 TSI 320 R 4Motion 5dr DSG',
'vin': 'WVWZZZCD0RW123548',
'year': 2023}
2026-03-12 19:57:31 [arval.uk] INFO: Saving data for 129377: {'created_time': 1773345451.156203, 'last_price_update_time': 1773345451.156214}
2026-03-12 19:57:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128902)
2026-03-12 19:57:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:57:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66053210>
2026-03-12 19:57:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/6.jpeg saved to cache
2026-03-12 19:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380
2026-03-12 19:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128902)
2026-03-12 19:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66052610>
2026-03-12 19:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/5.jpeg saved to cache
2026-03-12 19:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380
2026-03-12 19:57:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122954> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:57:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6 with identifier: 122954
2026-03-12 19:57:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6 with scrape type 1
2026-03-12 19:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6
2026-03-12 19:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/0.jpeg not downloaded yet
2026-03-12 19:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/1.jpeg not downloaded yet
2026-03-12 19:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/2.jpeg not downloaded yet
2026-03-12 19:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128902)
2026-03-12 19:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/3.jpeg not downloaded yet
2026-03-12 19:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/4.jpeg not downloaded yet
2026-03-12 19:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/5.jpeg not downloaded yet
2026-03-12 19:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/6.jpeg not downloaded yet
2026-03-12 19:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/7.jpeg not downloaded yet
2026-03-12 19:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/8.jpeg not downloaded yet
2026-03-12 19:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/9.jpeg not downloaded yet
2026-03-12 19:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a8f10>
2026-03-12 19:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/4.jpeg saved to cache
2026-03-12 19:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380
2026-03-12 19:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128902)
2026-03-12 19:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607a190>
2026-03-12 19:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/3.jpeg saved to cache
2026-03-12 19:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380
2026-03-12 19:57:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:57:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124639> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:57:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86acc657-ed70-5864-a890-9b4504ef908e with identifier: 124639
2026-03-12 19:57:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86acc657-ed70-5864-a890-9b4504ef908e with scrape type 1
2026-03-12 19:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86acc657-ed70-5864-a890-9b4504ef908e
2026-03-12 19:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/0.jpeg not downloaded yet
2026-03-12 19:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/1.jpeg not downloaded yet
2026-03-12 19:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/2.jpeg not downloaded yet
2026-03-12 19:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/3.jpeg not downloaded yet
2026-03-12 19:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/4.jpeg not downloaded yet
2026-03-12 19:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/5.jpeg not downloaded yet
2026-03-12 19:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/6.jpeg not downloaded yet
2026-03-12 19:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/7.jpeg not downloaded yet
2026-03-12 19:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/8.jpeg not downloaded yet
2026-03-12 19:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/9.jpeg not downloaded yet
2026-03-12 19:57:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128902)
2026-03-12 19:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67707950>
2026-03-12 19:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/2.jpeg saved to cache
2026-03-12 19:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380
2026-03-12 19:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128783> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128902)
2026-03-12 19:57:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff00289c-80f9-5c30-9793-0eee07c6b517 with identifier: 128783
2026-03-12 19:57:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff00289c-80f9-5c30-9793-0eee07c6b517 with scrape type 1
2026-03-12 19:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff00289c-80f9-5c30-9793-0eee07c6b517
2026-03-12 19:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/0.jpeg not downloaded yet
2026-03-12 19:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/1.jpeg not downloaded yet
2026-03-12 19:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/2.jpeg not downloaded yet
2026-03-12 19:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/3.jpeg not downloaded yet
2026-03-12 19:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/4.jpeg not downloaded yet
2026-03-12 19:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/5.jpeg not downloaded yet
2026-03-12 19:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/6.jpeg not downloaded yet
2026-03-12 19:57:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67646090>
2026-03-12 19:57:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/1.jpeg saved to cache
2026-03-12 19:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380
2026-03-12 19:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/7.jpeg not downloaded yet
2026-03-12 19:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/8.jpeg not downloaded yet
2026-03-12 19:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/9.jpeg not downloaded yet
2026-03-12 19:57:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128902)
2026-03-12 19:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb2350>
2026-03-12 19:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/0.jpeg saved to cache
2026-03-12 19:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380
2026-03-12 19:57:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380, skipping ID generation
2026-03-12 19:57:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380 with scrape type 1
2026-03-12 19:57:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380 sending to next pipeline
2026-03-12 19:57:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380, identifier: 128902
2026-03-12 19:57:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380 with identifier: 128902
2026-03-12 19:57:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 19:57:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380 with identifier: 128902
2026-03-12 19:57:37 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 0f5ff2d0-7b24-5209-a5af-6fa71c1c8380 with identifier: 128902 to the API
2026-03-12 19:57:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:57:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:57:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.9L',
'engine_horse_power': 234,
'expiration_date': None,
'fuel_type': 'Diesel',
'id': '0f5ff2d0-7b24-5209-a5af-6fa71c1c8380',
'is_damaged': False,
'is_operable': True,
'license_plate': 'LS23EFV',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/mercedes-v-class-diesel-estate-2019-v300-d-237-amg-line-5dr-9g-tronic-extra-long-128902',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Mercedes',
'model': 'V CLASS DIESEL ESTATE (2019)',
'odometer': 14450,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64431,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64740,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78708,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61754,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58590,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54149,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66745,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60593,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66586,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f5ff2d0-7b24-5209-a5af-6fa71c1c8380/0f5ff2d0-7b24-5209-a5af-6fa71c1c8380_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105192,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128902/9.jpeg',
'Width': 800}],
'price': 52200.0,
'price_includes_vat': True,
'registration_date': '2023-03-23',
'seats_number': 8,
'seller_name': None,
'title': 'Mercedes V CLASS DIESEL ESTATE (2019) V300 d 237 AMG Line 5dr '
'9G-Tronic [Extra Long]',
'transmission': 'automatic',
'trim': 'V300 d 237 AMG Line 5dr 9G-Tronic [Extra Long]',
'vin': 'W1VVNLFZ7P4204255',
'year': 2023}
2026-03-12 19:57:37 [arval.uk] INFO: Saving data for 128902: {'created_time': 1773345457.989279, 'last_price_update_time': 1773345457.989288}
2026-03-12 19:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124006)
2026-03-12 19:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67615410>
2026-03-12 19:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/9.jpeg saved to cache
2026-03-12 19:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 623097f6-9a15-5819-8438-4d5ee439cbf6
2026-03-12 19:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124006)
2026-03-12 19:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67638690>
2026-03-12 19:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/8.jpeg saved to cache
2026-03-12 19:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 623097f6-9a15-5819-8438-4d5ee439cbf6
2026-03-12 19:57:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124006)
2026-03-12 19:57:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a7b50>
2026-03-12 19:57:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/6.jpeg saved to cache
2026-03-12 19:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 623097f6-9a15-5819-8438-4d5ee439cbf6
2026-03-12 19:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124006)
2026-03-12 19:57:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7a010>
2026-03-12 19:57:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/5.jpeg saved to cache
2026-03-12 19:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 623097f6-9a15-5819-8438-4d5ee439cbf6
2026-03-12 19:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124006)
2026-03-12 19:57:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67633950>
2026-03-12 19:57:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/4.jpeg saved to cache
2026-03-12 19:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 623097f6-9a15-5819-8438-4d5ee439cbf6
2026-03-12 19:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124006)
2026-03-12 19:57:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67680410>
2026-03-12 19:57:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/3.jpeg saved to cache
2026-03-12 19:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 623097f6-9a15-5819-8438-4d5ee439cbf6
2026-03-12 19:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124006)
2026-03-12 19:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66065290>
2026-03-12 19:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/2.jpeg saved to cache
2026-03-12 19:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 623097f6-9a15-5819-8438-4d5ee439cbf6
2026-03-12 19:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124006)
2026-03-12 19:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67771890>
2026-03-12 19:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/1.jpeg saved to cache
2026-03-12 19:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 623097f6-9a15-5819-8438-4d5ee439cbf6
2026-03-12 19:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124006)
2026-03-12 19:57:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedd310>
2026-03-12 19:57:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/0.jpeg saved to cache
2026-03-12 19:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 623097f6-9a15-5819-8438-4d5ee439cbf6
2026-03-12 19:57:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 623097f6-9a15-5819-8438-4d5ee439cbf6, skipping ID generation
2026-03-12 19:57:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 623097f6-9a15-5819-8438-4d5ee439cbf6 with scrape type 1
2026-03-12 19:57:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 623097f6-9a15-5819-8438-4d5ee439cbf6 sending to next pipeline
2026-03-12 19:57:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 623097f6-9a15-5819-8438-4d5ee439cbf6, identifier: 124006
2026-03-12 19:57:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 623097f6-9a15-5819-8438-4d5ee439cbf6 with identifier: 124006
2026-03-12 19:57:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 19:57:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 19:57:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 623097f6-9a15-5819-8438-4d5ee439cbf6 with identifier: 124006
2026-03-12 19:57:46 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 623097f6-9a15-5819-8438-4d5ee439cbf6 with identifier: 124006 to the API
2026-03-12 19:57:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:57:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:57:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'engine_horse_power': 389,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': '623097f6-9a15-5819-8438-4d5ee439cbf6',
'is_damaged': False,
'is_operable': True,
'license_plate': 'FE21VKD',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/bmw-x5-estate-2018-xdrive45e-m-sport-5dr-auto-tech-pack-124006',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'BMW',
'model': 'X5 ESTATE (2018)',
'odometer': 35177,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69729,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70343,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74163,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69292,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65705,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65190,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52031,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71619,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55679,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_623097f6-9a15-5819-8438-4d5ee439cbf6/623097f6-9a15-5819-8438-4d5ee439cbf6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72434,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124006/9.jpeg',
'Width': 1280}],
'price': 38600.0,
'price_includes_vat': True,
'registration_date': '2021-04-19',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 ESTATE (2018) xDrive45e M Sport 5dr Auto [Tech Pack]',
'transmission': 'automatic',
'trim': 'xDrive45e M Sport 5dr Auto [Tech Pack]',
'vin': 'WBATA620309F62254',
'year': 2021}
2026-03-12 19:57:46 [arval.uk] INFO: Saving data for 124006: {'created_time': 1773345466.888499, 'last_price_update_time': 1773345466.88851}
2026-03-12 19:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122954)
2026-03-12 19:57:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cff1110>
2026-03-12 19:57:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/2.jpeg saved to cache
2026-03-12 19:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6
2026-03-12 19:57:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122954)
2026-03-12 19:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6ceddd50>
2026-03-12 19:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/9.jpeg saved to cache
2026-03-12 19:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6
2026-03-12 19:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122954)
2026-03-12 19:57:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee22d0>
2026-03-12 19:57:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/8.jpeg saved to cache
2026-03-12 19:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6
2026-03-12 19:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124639)
2026-03-12 19:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67704ad0>
2026-03-12 19:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/9.jpeg saved to cache
2026-03-12 19:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86acc657-ed70-5864-a890-9b4504ef908e
2026-03-12 19:57:51 [scrapy.extensions.logstats] INFO: Crawled 44 pages (at 3 pages/min), scraped 8 items (at 5 items/min)
2026-03-12 19:57:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 19:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124639)
2026-03-12 19:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f8210>
2026-03-12 19:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/8.jpeg saved to cache
2026-03-12 19:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86acc657-ed70-5864-a890-9b4504ef908e
2026-03-12 19:57:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124639)
2026-03-12 19:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67707810>
2026-03-12 19:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/7.jpeg saved to cache
2026-03-12 19:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86acc657-ed70-5864-a890-9b4504ef908e
2026-03-12 19:57:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128783)
2026-03-12 19:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6719bcd0>
2026-03-12 19:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/9.jpeg saved to cache
2026-03-12 19:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff00289c-80f9-5c30-9793-0eee07c6b517
2026-03-12 19:57:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128783)
2026-03-12 19:57:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67179650>
2026-03-12 19:57:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/8.jpeg saved to cache
2026-03-12 19:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff00289c-80f9-5c30-9793-0eee07c6b517
2026-03-12 19:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128783)
2026-03-12 19:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a9250>
2026-03-12 19:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/7.jpeg saved to cache
2026-03-12 19:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff00289c-80f9-5c30-9793-0eee07c6b517
2026-03-12 19:57:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128783)
2026-03-12 19:57:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676445d0>
2026-03-12 19:57:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/6.jpeg saved to cache
2026-03-12 19:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff00289c-80f9-5c30-9793-0eee07c6b517
2026-03-12 19:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128783)
2026-03-12 19:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6719b290>
2026-03-12 19:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:57:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:57:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/5.jpeg saved to cache
2026-03-12 19:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff00289c-80f9-5c30-9793-0eee07c6b517
2026-03-12 19:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128783)
2026-03-12 19:57:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:57:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67647890>
2026-03-12 19:57:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/4.jpeg saved to cache
2026-03-12 19:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff00289c-80f9-5c30-9793-0eee07c6b517
2026-03-12 19:58:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128783)
2026-03-12 19:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aba10>
2026-03-12 19:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/3.jpeg saved to cache
2026-03-12 19:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff00289c-80f9-5c30-9793-0eee07c6b517
2026-03-12 19:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128783)
2026-03-12 19:58:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67144690>
2026-03-12 19:58:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/2.jpeg saved to cache
2026-03-12 19:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff00289c-80f9-5c30-9793-0eee07c6b517
2026-03-12 19:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128783)
2026-03-12 19:58:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67739450>
2026-03-12 19:58:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/1.jpeg saved to cache
2026-03-12 19:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff00289c-80f9-5c30-9793-0eee07c6b517
2026-03-12 19:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128783)
2026-03-12 19:58:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67630e10>
2026-03-12 19:58:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/0.jpeg saved to cache
2026-03-12 19:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff00289c-80f9-5c30-9793-0eee07c6b517
2026-03-12 19:58:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff00289c-80f9-5c30-9793-0eee07c6b517, skipping ID generation
2026-03-12 19:58:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff00289c-80f9-5c30-9793-0eee07c6b517 with scrape type 1
2026-03-12 19:58:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff00289c-80f9-5c30-9793-0eee07c6b517 sending to next pipeline
2026-03-12 19:58:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: ff00289c-80f9-5c30-9793-0eee07c6b517, identifier: 128783
2026-03-12 19:58:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: ff00289c-80f9-5c30-9793-0eee07c6b517 with identifier: 128783
2026-03-12 19:58:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: ff00289c-80f9-5c30-9793-0eee07c6b517 with identifier: 128783
2026-03-12 19:58:05 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: ff00289c-80f9-5c30-9793-0eee07c6b517 with identifier: 128783 to the API
2026-03-12 19:58:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:58:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:58:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 296,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'ff00289c-80f9-5c30-9793-0eee07c6b517',
'is_damaged': False,
'is_operable': True,
'license_plate': 'VE23GPZ',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-20-tsi-300-gti-clubsport-5dr-dsg-128783',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 14173,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67958,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74294,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69310,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69075,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71141,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66111,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72299,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69427,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61201,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff00289c-80f9-5c30-9793-0eee07c6b517/ff00289c-80f9-5c30-9793-0eee07c6b517_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93552,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128783/9.jpeg',
'Width': 800}],
'price': 30500.0,
'price_includes_vat': True,
'registration_date': '2023-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 2.0 TSI 300 GTI Clubsport 5dr DSG',
'transmission': 'automatic',
'trim': '2.0 TSI 300 GTI Clubsport 5dr DSG',
'vin': 'WVWZZZCD8PW195756',
'year': 2023}
2026-03-12 19:58:05 [arval.uk] INFO: Saving data for 128783: {'created_time': 1773345485.492978, 'last_price_update_time': 1773345485.492988}
2026-03-12 19:58:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124639)
2026-03-12 19:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb3750>
2026-03-12 19:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/6.jpeg saved to cache
2026-03-12 19:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86acc657-ed70-5864-a890-9b4504ef908e
2026-03-12 19:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124639)
2026-03-12 19:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66065090>
2026-03-12 19:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/5.jpeg saved to cache
2026-03-12 19:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86acc657-ed70-5864-a890-9b4504ef908e
2026-03-12 19:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124639)
2026-03-12 19:58:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18d690>
2026-03-12 19:58:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/4.jpeg saved to cache
2026-03-12 19:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86acc657-ed70-5864-a890-9b4504ef908e
2026-03-12 19:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124639)
2026-03-12 19:58:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7a610>
2026-03-12 19:58:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/3.jpeg saved to cache
2026-03-12 19:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86acc657-ed70-5864-a890-9b4504ef908e
2026-03-12 19:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124639)
2026-03-12 19:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a9a50>
2026-03-12 19:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/2.jpeg saved to cache
2026-03-12 19:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86acc657-ed70-5864-a890-9b4504ef908e
2026-03-12 19:58:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124639)
2026-03-12 19:58:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66065050>
2026-03-12 19:58:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/1.jpeg saved to cache
2026-03-12 19:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86acc657-ed70-5864-a890-9b4504ef908e
2026-03-12 19:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124639)
2026-03-12 19:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67145810>
2026-03-12 19:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/0.jpeg saved to cache
2026-03-12 19:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86acc657-ed70-5864-a890-9b4504ef908e
2026-03-12 19:58:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86acc657-ed70-5864-a890-9b4504ef908e, skipping ID generation
2026-03-12 19:58:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86acc657-ed70-5864-a890-9b4504ef908e with scrape type 1
2026-03-12 19:58:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86acc657-ed70-5864-a890-9b4504ef908e sending to next pipeline
2026-03-12 19:58:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 86acc657-ed70-5864-a890-9b4504ef908e, identifier: 124639
2026-03-12 19:58:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 86acc657-ed70-5864-a890-9b4504ef908e with identifier: 124639
2026-03-12 19:58:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 86acc657-ed70-5864-a890-9b4504ef908e with identifier: 124639
2026-03-12 19:58:13 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 86acc657-ed70-5864-a890-9b4504ef908e with identifier: 124639 to the API
2026-03-12 19:58:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:58:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:58:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 227,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': '86acc657-ed70-5864-a890-9b4504ef908e',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BP72YAG',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-santa-fe-estate-2021-16-tgdi-hybrid-ultimate-5dr-4wd-auto-124639',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Hyundai',
'model': 'SANTA FE ESTATE (2021)',
'odometer': 14851,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70133,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67474,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69872,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59846,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63364,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106610,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47448,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117488,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99491,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86acc657-ed70-5864-a890-9b4504ef908e/86acc657-ed70-5864-a890-9b4504ef908e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93318,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124639/9.jpeg',
'Width': 1280}],
'price': 31200.0,
'price_includes_vat': True,
'registration_date': '2023-01-12',
'seats_number': 7,
'seller_name': None,
'title': 'Hyundai SANTA FE ESTATE (2021) 1.6 TGDi Hybrid Ultimate 5dr 4WD '
'Auto',
'transmission': 'automatic',
'trim': '1.6 TGDi Hybrid Ultimate 5dr 4WD Auto',
'vin': 'KMHS5811SPU061589',
'year': 2023}
2026-03-12 19:58:14 [arval.uk] INFO: Saving data for 124639: {'created_time': 1773345494.213553, 'last_price_update_time': 1773345494.213565}
2026-03-12 19:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122954)
2026-03-12 19:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16c810>
2026-03-12 19:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/7.jpeg saved to cache
2026-03-12 19:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6
2026-03-12 19:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122954)
2026-03-12 19:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa550>
2026-03-12 19:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/6.jpeg saved to cache
2026-03-12 19:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6
2026-03-12 19:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122954)
2026-03-12 19:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67145e10>
2026-03-12 19:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/5.jpeg saved to cache
2026-03-12 19:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6
2026-03-12 19:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122954)
2026-03-12 19:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16f790>
2026-03-12 19:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/4.jpeg saved to cache
2026-03-12 19:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6
2026-03-12 19:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122954)
2026-03-12 19:58:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a7550>
2026-03-12 19:58:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/3.jpeg saved to cache
2026-03-12 19:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6
2026-03-12 19:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122954)
2026-03-12 19:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66065e50>
2026-03-12 19:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/1.jpeg saved to cache
2026-03-12 19:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6
2026-03-12 19:58:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122954)
2026-03-12 19:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766e410>
2026-03-12 19:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/0.jpeg saved to cache
2026-03-12 19:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6
2026-03-12 19:58:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6, skipping ID generation
2026-03-12 19:58:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6 with scrape type 1
2026-03-12 19:58:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6 sending to next pipeline
2026-03-12 19:58:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6, identifier: 122954
2026-03-12 19:58:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6 with identifier: 122954
2026-03-12 19:58:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6 with identifier: 122954
2026-03-12 19:58:21 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6 with identifier: 122954 to the API
2026-03-12 19:58:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:58:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:58:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 306,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6',
'is_damaged': False,
'is_operable': True,
'license_plate': 'LT73OSN',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-a3-sportback-2020-s3-tfsi-quattro-vorsprung-5dr-s-tronic-122954',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'A3 SPORTBACK (2020)',
'odometer': 54286,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 46,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79575,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77030,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97014,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83893,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62128,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89239,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83431,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75924,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 16150,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6/ba44e2c3-3f0c-5f33-b6e5-0cbc5b3adcd6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54969,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122954/9.jpeg',
'Width': 800}],
'price': 31300.0,
'price_includes_vat': True,
'registration_date': '2023-09-11',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 SPORTBACK (2020) S3 TFSI Quattro Vorsprung 5dr S Tronic',
'transmission': 'automatic',
'trim': 'S3 TFSI Quattro Vorsprung 5dr S Tronic',
'vin': 'WAUZZZGYXRA014084',
'year': 2023}
2026-03-12 19:58:22 [arval.uk] INFO: Saving data for 122954: {'created_time': 1773345502.243088, 'last_price_update_time': 1773345502.243101}
2026-03-12 19:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123932)
2026-03-12 19:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a6dd0>
2026-03-12 19:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/8.jpeg saved to cache
2026-03-12 19:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1697f7c1-068d-5074-b14f-18e7c10d60ed
2026-03-12 19:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123932)
2026-03-12 19:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a8190>
2026-03-12 19:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/7.jpeg saved to cache
2026-03-12 19:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1697f7c1-068d-5074-b14f-18e7c10d60ed
2026-03-12 19:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123932)
2026-03-12 19:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766e210>
2026-03-12 19:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/6.jpeg saved to cache
2026-03-12 19:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1697f7c1-068d-5074-b14f-18e7c10d60ed
2026-03-12 19:58:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123932)
2026-03-12 19:58:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67617a50>
2026-03-12 19:58:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/5.jpeg saved to cache
2026-03-12 19:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1697f7c1-068d-5074-b14f-18e7c10d60ed
2026-03-12 19:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123932)
2026-03-12 19:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee2c50>
2026-03-12 19:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/4.jpeg saved to cache
2026-03-12 19:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1697f7c1-068d-5074-b14f-18e7c10d60ed
2026-03-12 19:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123932)
2026-03-12 19:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbde4d0>
2026-03-12 19:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/3.jpeg saved to cache
2026-03-12 19:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1697f7c1-068d-5074-b14f-18e7c10d60ed
2026-03-12 19:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123932)
2026-03-12 19:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0dd490>
2026-03-12 19:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/2.jpeg saved to cache
2026-03-12 19:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1697f7c1-068d-5074-b14f-18e7c10d60ed
2026-03-12 19:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123932)
2026-03-12 19:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbdd6d0>
2026-03-12 19:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/1.jpeg saved to cache
2026-03-12 19:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1697f7c1-068d-5074-b14f-18e7c10d60ed
2026-03-12 19:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123932)
2026-03-12 19:58:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717add0>
2026-03-12 19:58:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/0.jpeg saved to cache
2026-03-12 19:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1697f7c1-068d-5074-b14f-18e7c10d60ed
2026-03-12 19:58:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1697f7c1-068d-5074-b14f-18e7c10d60ed, skipping ID generation
2026-03-12 19:58:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1697f7c1-068d-5074-b14f-18e7c10d60ed with scrape type 1
2026-03-12 19:58:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1697f7c1-068d-5074-b14f-18e7c10d60ed sending to next pipeline
2026-03-12 19:58:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 1697f7c1-068d-5074-b14f-18e7c10d60ed, identifier: 123932
2026-03-12 19:58:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 1697f7c1-068d-5074-b14f-18e7c10d60ed with identifier: 123932
2026-03-12 19:58:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 1697f7c1-068d-5074-b14f-18e7c10d60ed with identifier: 123932
2026-03-12 19:58:32 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 1697f7c1-068d-5074-b14f-18e7c10d60ed with identifier: 123932 to the API
2026-03-12 19:58:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:58:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:58:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '1697f7c1-068d-5074-b14f-18e7c10d60ed',
'is_damaged': False,
'is_operable': True,
'license_plate': 'WN73TXA',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-15-etsi-150-r-line-5dr-dsg-123932',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 26559,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 57,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47399,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37669,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46017,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44959,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43883,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32703,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42721,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46577,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80553,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1697f7c1-068d-5074-b14f-18e7c10d60ed/1697f7c1-068d-5074-b14f-18e7c10d60ed_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42865,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123932/9.jpeg',
'Width': 800}],
'price': 20500.0,
'price_includes_vat': True,
'registration_date': '2023-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 1.5 eTSI 150 R-Line 5dr DSG',
'transmission': 'automatic',
'trim': '1.5 eTSI 150 R-Line 5dr DSG',
'vin': 'WVWZZZCD4RW119583',
'year': 2023}
2026-03-12 19:58:33 [arval.uk] INFO: Saving data for 123932: {'created_time': 1773345513.229867, 'last_price_update_time': 1773345513.229876}
2026-03-12 19:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127304)
2026-03-12 19:58:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67639650>
2026-03-12 19:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/6.jpeg saved to cache
2026-03-12 19:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac
2026-03-12 19:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127304)
2026-03-12 19:58:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedb010>
2026-03-12 19:58:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/5.jpeg saved to cache
2026-03-12 19:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac
2026-03-12 19:58:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:58:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127304)
2026-03-12 19:58:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a6090>
2026-03-12 19:58:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/4.jpeg saved to cache
2026-03-12 19:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac
2026-03-12 19:58:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128152> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:58:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b011e45-185f-517f-8869-e3816e9c3130 with identifier: 128152
2026-03-12 19:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b011e45-185f-517f-8869-e3816e9c3130 with scrape type 1
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b011e45-185f-517f-8869-e3816e9c3130
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/0.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/1.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/2.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/3.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/4.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/5.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/6.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/7.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/8.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/9.jpeg not downloaded yet
2026-03-12 19:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122780> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:58:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:58:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 776a0940-45a4-50f6-a3b3-8efee01bc2ad with identifier: 122780
2026-03-12 19:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad with scrape type 1
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/0.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/1.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/2.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/3.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/4.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/5.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/6.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/7.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/8.jpeg not downloaded yet
2026-03-12 19:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/9.jpeg not downloaded yet
2026-03-12 19:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127304)
2026-03-12 19:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedb350>
2026-03-12 19:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/3.jpeg saved to cache
2026-03-12 19:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac
2026-03-12 19:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117221> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:58:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed47e460-6fbb-5a81-ac56-3cc61d578ca2 with identifier: 117221
2026-03-12 19:58:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2 with scrape type 1
2026-03-12 19:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2
2026-03-12 19:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/0.jpeg not downloaded yet
2026-03-12 19:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/1.jpeg not downloaded yet
2026-03-12 19:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/2.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/3.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/4.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/5.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/6.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/7.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/8.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/9.jpeg not downloaded yet
2026-03-12 19:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126501> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:58:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 748be463-80f4-5c9c-8428-686d6d900d35 with identifier: 126501
2026-03-12 19:58:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 748be463-80f4-5c9c-8428-686d6d900d35 with scrape type 1
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 748be463-80f4-5c9c-8428-686d6d900d35
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/0.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/1.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/2.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/3.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/4.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/5.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/6.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/7.jpeg not downloaded yet
2026-03-12 19:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127304)
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/8.jpeg not downloaded yet
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/9.jpeg not downloaded yet
2026-03-12 19:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713e4d0>
2026-03-12 19:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/2.jpeg saved to cache
2026-03-12 19:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac
2026-03-12 19:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127304)
2026-03-12 19:58:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67751890>
2026-03-12 19:58:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/1.jpeg saved to cache
2026-03-12 19:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac
2026-03-12 19:58:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127304)
2026-03-12 19:58:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb2d50>
2026-03-12 19:58:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/0.jpeg saved to cache
2026-03-12 19:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac
2026-03-12 19:58:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12661ac9-5641-5f42-bfc8-bfbf15fb65ac, skipping ID generation
2026-03-12 19:58:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac with scrape type 1
2026-03-12 19:58:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12661ac9-5641-5f42-bfc8-bfbf15fb65ac sending to next pipeline
2026-03-12 19:58:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 12661ac9-5641-5f42-bfc8-bfbf15fb65ac, identifier: 127304
2026-03-12 19:58:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 12661ac9-5641-5f42-bfc8-bfbf15fb65ac with identifier: 127304
2026-03-12 19:58:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 12661ac9-5641-5f42-bfc8-bfbf15fb65ac with identifier: 127304
2026-03-12 19:58:41 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 12661ac9-5641-5f42-bfc8-bfbf15fb65ac with identifier: 127304 to the API
2026-03-12 19:58:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:58:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:58:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 227,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': '12661ac9-5641-5f42-bfc8-bfbf15fb65ac',
'is_damaged': False,
'is_operable': True,
'license_plate': 'KP72UJG',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-santa-fe-estate-2021-16-tgdi-hybrid-premium-5dr-auto-127304',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Hyundai',
'model': 'SANTA FE ESTATE (2021)',
'odometer': 19436,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55946,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58504,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54087,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52674,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45352,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53356,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53218,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53906,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30151,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12661ac9-5641-5f42-bfc8-bfbf15fb65ac/12661ac9-5641-5f42-bfc8-bfbf15fb65ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31699,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127304/9.jpeg',
'Width': 800}],
'price': 27800.0,
'price_includes_vat': True,
'registration_date': '2022-12-28',
'seats_number': 7,
'seller_name': None,
'title': 'Hyundai SANTA FE ESTATE (2021) 1.6 TGDi Hybrid Premium 5dr Auto',
'transmission': 'automatic',
'trim': '1.6 TGDi Hybrid Premium 5dr Auto',
'vin': 'KMHS3811MPU062042',
'year': 2022}
2026-03-12 19:58:41 [arval.uk] INFO: Saving data for 127304: {'created_time': 1773345521.644753, 'last_price_update_time': 1773345521.644762}
2026-03-12 19:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123496)
2026-03-12 19:58:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c17a150>
2026-03-12 19:58:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/8.jpeg saved to cache
2026-03-12 19:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1
2026-03-12 19:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123496)
2026-03-12 19:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66097dd0>
2026-03-12 19:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/7.jpeg saved to cache
2026-03-12 19:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1
2026-03-12 19:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123496)
2026-03-12 19:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766e990>
2026-03-12 19:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/6.jpeg saved to cache
2026-03-12 19:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1
2026-03-12 19:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123496)
2026-03-12 19:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66097a50>
2026-03-12 19:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/5.jpeg saved to cache
2026-03-12 19:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1
2026-03-12 19:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123496)
2026-03-12 19:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a9590>
2026-03-12 19:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/4.jpeg saved to cache
2026-03-12 19:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1
2026-03-12 19:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123496)
2026-03-12 19:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67606bd0>
2026-03-12 19:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/3.jpeg saved to cache
2026-03-12 19:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1
2026-03-12 19:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123496)
2026-03-12 19:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66067010>
2026-03-12 19:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/2.jpeg saved to cache
2026-03-12 19:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1
2026-03-12 19:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123496)
2026-03-12 19:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cba3750>
2026-03-12 19:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/1.jpeg saved to cache
2026-03-12 19:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1
2026-03-12 19:58:51 [scrapy.extensions.logstats] INFO: Crawled 48 pages (at 4 pages/min), scraped 13 items (at 5 items/min)
2026-03-12 19:58:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 19:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123496)
2026-03-12 19:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660659d0>
2026-03-12 19:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/0.jpeg saved to cache
2026-03-12 19:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1
2026-03-12 19:58:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2807c090-c73d-5930-9d2e-1f3ae2901bf1, skipping ID generation
2026-03-12 19:58:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1 with scrape type 1
2026-03-12 19:58:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2807c090-c73d-5930-9d2e-1f3ae2901bf1 sending to next pipeline
2026-03-12 19:58:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 2807c090-c73d-5930-9d2e-1f3ae2901bf1, identifier: 123496
2026-03-12 19:58:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 2807c090-c73d-5930-9d2e-1f3ae2901bf1 with identifier: 123496
2026-03-12 19:58:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 2807c090-c73d-5930-9d2e-1f3ae2901bf1 with identifier: 123496
2026-03-12 19:58:52 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 2807c090-c73d-5930-9d2e-1f3ae2901bf1 with identifier: 123496 to the API
2026-03-12 19:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:58:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 242,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '2807c090-c73d-5930-9d2e-1f3ae2901bf1',
'is_damaged': False,
'is_operable': True,
'license_plate': 'VE22OOA',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-20-tsi-gti-5dr-dsg-123496',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 36772,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62579,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61467,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54981,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46754,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50601,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143876,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83514,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112965,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81525,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2807c090-c73d-5930-9d2e-1f3ae2901bf1/2807c090-c73d-5930-9d2e-1f3ae2901bf1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82918,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123496/9.jpeg',
'Width': 1280}],
'price': 23600.0,
'price_includes_vat': True,
'registration_date': '2022-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 2.0 TSI GTI 5dr DSG',
'transmission': 'automatic',
'trim': '2.0 TSI GTI 5dr DSG',
'vin': 'WVWZZZCDZNW209124',
'year': 2022}
2026-03-12 19:58:52 [arval.uk] INFO: Saving data for 123496: {'created_time': 1773345532.986229, 'last_price_update_time': 1773345532.986239}
2026-03-12 19:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128152)
2026-03-12 19:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67771010>
2026-03-12 19:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/9.jpeg saved to cache
2026-03-12 19:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b011e45-185f-517f-8869-e3816e9c3130
2026-03-12 19:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122780)
2026-03-12 19:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a9650>
2026-03-12 19:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/9.jpeg saved to cache
2026-03-12 19:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad
2026-03-12 19:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122780)
2026-03-12 19:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718f6d0>
2026-03-12 19:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/8.jpeg saved to cache
2026-03-12 19:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad
2026-03-12 19:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117221)
2026-03-12 19:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedb410>
2026-03-12 19:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/9.jpeg saved to cache
2026-03-12 19:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2
2026-03-12 19:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126501)
2026-03-12 19:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67707550>
2026-03-12 19:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/6.jpeg saved to cache
2026-03-12 19:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 748be463-80f4-5c9c-8428-686d6d900d35
2026-03-12 19:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126501)
2026-03-12 19:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb1850>
2026-03-12 19:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/9.jpeg saved to cache
2026-03-12 19:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 748be463-80f4-5c9c-8428-686d6d900d35
2026-03-12 19:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126501)
2026-03-12 19:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604e210>
2026-03-12 19:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/8.jpeg saved to cache
2026-03-12 19:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 748be463-80f4-5c9c-8428-686d6d900d35
2026-03-12 19:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126501)
2026-03-12 19:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677b9c90>
2026-03-12 19:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/7.jpeg saved to cache
2026-03-12 19:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 748be463-80f4-5c9c-8428-686d6d900d35
2026-03-12 19:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126501)
2026-03-12 19:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67752ad0>
2026-03-12 19:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/5.jpeg saved to cache
2026-03-12 19:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 748be463-80f4-5c9c-8428-686d6d900d35
2026-03-12 19:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126501)
2026-03-12 19:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67704b50>
2026-03-12 19:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/4.jpeg saved to cache
2026-03-12 19:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 748be463-80f4-5c9c-8428-686d6d900d35
2026-03-12 19:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126501)
2026-03-12 19:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66065650>
2026-03-12 19:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/3.jpeg saved to cache
2026-03-12 19:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 748be463-80f4-5c9c-8428-686d6d900d35
2026-03-12 19:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126501)
2026-03-12 19:59:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713e490>
2026-03-12 19:59:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/2.jpeg saved to cache
2026-03-12 19:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 748be463-80f4-5c9c-8428-686d6d900d35
2026-03-12 19:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126501)
2026-03-12 19:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604ea90>
2026-03-12 19:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/1.jpeg saved to cache
2026-03-12 19:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 748be463-80f4-5c9c-8428-686d6d900d35
2026-03-12 19:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126501)
2026-03-12 19:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16f110>
2026-03-12 19:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/0.jpeg saved to cache
2026-03-12 19:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 748be463-80f4-5c9c-8428-686d6d900d35
2026-03-12 19:59:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 748be463-80f4-5c9c-8428-686d6d900d35, skipping ID generation
2026-03-12 19:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 748be463-80f4-5c9c-8428-686d6d900d35 with scrape type 1
2026-03-12 19:59:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 748be463-80f4-5c9c-8428-686d6d900d35 sending to next pipeline
2026-03-12 19:59:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 748be463-80f4-5c9c-8428-686d6d900d35, identifier: 126501
2026-03-12 19:59:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 748be463-80f4-5c9c-8428-686d6d900d35 with identifier: 126501
2026-03-12 19:59:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 748be463-80f4-5c9c-8428-686d6d900d35 with identifier: 126501
2026-03-12 19:59:09 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 748be463-80f4-5c9c-8428-686d6d900d35 with identifier: 126501 to the API
2026-03-12 19:59:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:59:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 227,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': '748be463-80f4-5c9c-8428-686d6d900d35',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BL72USO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-santa-fe-estate-2021-16-tgdi-hybrid-premium-5dr-auto-126501',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Hyundai',
'model': 'SANTA FE ESTATE (2021)',
'odometer': 25240,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91317,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71573,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90098,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96921,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84868,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73845,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89050,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100941,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70683,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_748be463-80f4-5c9c-8428-686d6d900d35/748be463-80f4-5c9c-8428-686d6d900d35_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96002,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126501/9.jpeg',
'Width': 800}],
'price': 26700.0,
'price_includes_vat': True,
'registration_date': '2022-12-13',
'seats_number': 7,
'seller_name': None,
'title': 'Hyundai SANTA FE ESTATE (2021) 1.6 TGDi Hybrid Premium 5dr Auto',
'transmission': 'automatic',
'trim': '1.6 TGDi Hybrid Premium 5dr Auto',
'vin': 'KMHS3811MPU060824',
'year': 2022}
2026-03-12 19:59:09 [arval.uk] INFO: Saving data for 126501: {'created_time': 1773345549.301116, 'last_price_update_time': 1773345549.301129}
2026-03-12 19:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117221)
2026-03-12 19:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778ce50>
2026-03-12 19:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/8.jpeg saved to cache
2026-03-12 19:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2
2026-03-12 19:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117221)
2026-03-12 19:59:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66053090>
2026-03-12 19:59:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/7.jpeg saved to cache
2026-03-12 19:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2
2026-03-12 19:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117221)
2026-03-12 19:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4d490>
2026-03-12 19:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/6.jpeg saved to cache
2026-03-12 19:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2
2026-03-12 19:59:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117221)
2026-03-12 19:59:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676336d0>
2026-03-12 19:59:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/5.jpeg saved to cache
2026-03-12 19:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2
2026-03-12 19:59:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117221)
2026-03-12 19:59:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4c150>
2026-03-12 19:59:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/4.jpeg saved to cache
2026-03-12 19:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2
2026-03-12 19:59:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117221)
2026-03-12 19:59:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1de10>
2026-03-12 19:59:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/3.jpeg saved to cache
2026-03-12 19:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2
2026-03-12 19:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117221)
2026-03-12 19:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67753690>
2026-03-12 19:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/2.jpeg saved to cache
2026-03-12 19:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2
2026-03-12 19:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117221)
2026-03-12 19:59:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a0d10>
2026-03-12 19:59:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/1.jpeg saved to cache
2026-03-12 19:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2
2026-03-12 19:59:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117221)
2026-03-12 19:59:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16cd50>
2026-03-12 19:59:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/0.jpeg saved to cache
2026-03-12 19:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2
2026-03-12 19:59:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed47e460-6fbb-5a81-ac56-3cc61d578ca2, skipping ID generation
2026-03-12 19:59:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2 with scrape type 1
2026-03-12 19:59:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed47e460-6fbb-5a81-ac56-3cc61d578ca2 sending to next pipeline
2026-03-12 19:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: ed47e460-6fbb-5a81-ac56-3cc61d578ca2, identifier: 117221
2026-03-12 19:59:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: ed47e460-6fbb-5a81-ac56-3cc61d578ca2 with identifier: 117221
2026-03-12 19:59:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 19:59:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: ed47e460-6fbb-5a81-ac56-3cc61d578ca2 with identifier: 117221
2026-03-12 19:59:19 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: ed47e460-6fbb-5a81-ac56-3cc61d578ca2 with identifier: 117221 to the API
2026-03-12 19:59:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:59:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 334,
'expiration_date': None,
'fuel_type': 'Electric',
'id': 'ed47e460-6fbb-5a81-ac56-3cc61d578ca2',
'is_damaged': False,
'is_operable': True,
'license_plate': 'NK72MYM',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/bmw-i4-gran-coupe-2021-250kw-edrive40-m-sport-839kwh-5dr-auto-117221',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'BMW',
'model': 'I4 GRAN COUPE (2021)',
'odometer': 15390,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45658,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39241,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45800,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45173,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34125,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44609,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37860,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39809,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51130,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed47e460-6fbb-5a81-ac56-3cc61d578ca2/ed47e460-6fbb-5a81-ac56-3cc61d578ca2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96824,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117221/9.jpeg',
'Width': 800}],
'price': 26800.0,
'price_includes_vat': True,
'registration_date': '2022-09-07',
'seats_number': 5,
'seller_name': None,
'title': 'BMW I4 GRAN COUPE (2021) 250kW eDrive40 M Sport 83.9kWh 5dr Auto',
'transmission': 'automatic',
'trim': '250kW eDrive40 M Sport 83.9kWh 5dr Auto',
'vin': 'WBY72AW030FN23207',
'year': 2022}
2026-03-12 19:59:19 [arval.uk] INFO: Saving data for 117221: {'created_time': 1773345559.348191, 'last_price_update_time': 1773345559.3482}
2026-03-12 19:59:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122780)
2026-03-12 19:59:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa0d0>
2026-03-12 19:59:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/7.jpeg saved to cache
2026-03-12 19:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad
2026-03-12 19:59:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122780)
2026-03-12 19:59:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67706350>
2026-03-12 19:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/6.jpeg saved to cache
2026-03-12 19:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad
2026-03-12 19:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122780)
2026-03-12 19:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606bd50>
2026-03-12 19:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/5.jpeg saved to cache
2026-03-12 19:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad
2026-03-12 19:59:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123495> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:59:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5abf5a52-8e55-57e3-ba99-887239b34b9c with identifier: 123495
2026-03-12 19:59:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5abf5a52-8e55-57e3-ba99-887239b34b9c with scrape type 1
2026-03-12 19:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5abf5a52-8e55-57e3-ba99-887239b34b9c
2026-03-12 19:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/0.jpeg not downloaded yet
2026-03-12 19:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/1.jpeg not downloaded yet
2026-03-12 19:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/2.jpeg not downloaded yet
2026-03-12 19:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/3.jpeg not downloaded yet
2026-03-12 19:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/4.jpeg not downloaded yet
2026-03-12 19:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/5.jpeg not downloaded yet
2026-03-12 19:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/6.jpeg not downloaded yet
2026-03-12 19:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/7.jpeg not downloaded yet
2026-03-12 19:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/8.jpeg not downloaded yet
2026-03-12 19:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/9.jpeg not downloaded yet
2026-03-12 19:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122780)
2026-03-12 19:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66068fd0>
2026-03-12 19:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/4.jpeg saved to cache
2026-03-12 19:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad
2026-03-12 19:59:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122780)
2026-03-12 19:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f357d0>
2026-03-12 19:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/3.jpeg saved to cache
2026-03-12 19:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad
2026-03-12 19:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124651> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:59:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ff4989f-1271-55b1-a950-9937ee035094 with identifier: 124651
2026-03-12 19:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ff4989f-1271-55b1-a950-9937ee035094 with scrape type 1
2026-03-12 19:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ff4989f-1271-55b1-a950-9937ee035094
2026-03-12 19:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/0.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/1.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/2.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/3.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/4.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/5.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/6.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/7.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/8.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/9.jpeg not downloaded yet
2026-03-12 19:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122780)
2026-03-12 19:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f35ed0>
2026-03-12 19:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/2.jpeg saved to cache
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad
2026-03-12 19:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120953> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:59:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc4c98d-317b-5008-885b-4a11da4eb02a with identifier: 120953
2026-03-12 19:59:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc4c98d-317b-5008-885b-4a11da4eb02a with scrape type 1
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cc4c98d-317b-5008-885b-4a11da4eb02a
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/0.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/1.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/2.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/3.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/4.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/5.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/6.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/7.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/8.jpeg not downloaded yet
2026-03-12 19:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/9.jpeg not downloaded yet
2026-03-12 19:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122780)
2026-03-12 19:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a78d0>
2026-03-12 19:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/1.jpeg saved to cache
2026-03-12 19:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad
2026-03-12 19:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122780)
2026-03-12 19:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f350d0>
2026-03-12 19:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/0.jpeg saved to cache
2026-03-12 19:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad
2026-03-12 19:59:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 776a0940-45a4-50f6-a3b3-8efee01bc2ad, skipping ID generation
2026-03-12 19:59:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad with scrape type 1
2026-03-12 19:59:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 776a0940-45a4-50f6-a3b3-8efee01bc2ad sending to next pipeline
2026-03-12 19:59:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 776a0940-45a4-50f6-a3b3-8efee01bc2ad, identifier: 122780
2026-03-12 19:59:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 776a0940-45a4-50f6-a3b3-8efee01bc2ad with identifier: 122780
2026-03-12 19:59:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 776a0940-45a4-50f6-a3b3-8efee01bc2ad with identifier: 122780
2026-03-12 19:59:27 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 776a0940-45a4-50f6-a3b3-8efee01bc2ad with identifier: 122780 to the API
2026-03-12 19:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:59:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.9L',
'engine_horse_power': 302,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': '776a0940-45a4-50f6-a3b3-8efee01bc2ad',
'is_damaged': False,
'is_operable': True,
'license_plate': 'GY71NHB',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/mercedes-e-class-diesel-saloon-2020-e300de-amg-line-edition-4dr-9g-tronic-122780',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Mercedes',
'model': 'E CLASS DIESEL SALOON (2020)',
'odometer': 13932,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55734,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61734,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59222,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61402,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53823,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46931,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60874,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59816,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51382,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_776a0940-45a4-50f6-a3b3-8efee01bc2ad/776a0940-45a4-50f6-a3b3-8efee01bc2ad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123388,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/122780/9.jpeg',
'Width': 1280}],
'price': 27500.0,
'price_includes_vat': True,
'registration_date': '2021-11-01',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes E CLASS DIESEL SALOON (2020) E300de AMG Line Edition 4dr '
'9G-Tronic',
'transmission': 'automatic',
'trim': 'E300de AMG Line Edition 4dr 9G-Tronic',
'vin': 'W1K2130162A977855',
'year': 2021}
2026-03-12 19:59:27 [arval.uk] INFO: Saving data for 122780: {'created_time': 1773345567.286931, 'last_price_update_time': 1773345567.28694}
2026-03-12 19:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128152)
2026-03-12 19:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a8650>
2026-03-12 19:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/8.jpeg saved to cache
2026-03-12 19:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b011e45-185f-517f-8869-e3816e9c3130
2026-03-12 19:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128152)
2026-03-12 19:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ac550>
2026-03-12 19:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/7.jpeg saved to cache
2026-03-12 19:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b011e45-185f-517f-8869-e3816e9c3130
2026-03-12 19:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128152)
2026-03-12 19:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1d3d0>
2026-03-12 19:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/6.jpeg saved to cache
2026-03-12 19:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b011e45-185f-517f-8869-e3816e9c3130
2026-03-12 19:59:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128152)
2026-03-12 19:59:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ab290>
2026-03-12 19:59:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/5.jpeg saved to cache
2026-03-12 19:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b011e45-185f-517f-8869-e3816e9c3130
2026-03-12 19:59:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128152)
2026-03-12 19:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67629cd0>
2026-03-12 19:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/4.jpeg saved to cache
2026-03-12 19:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b011e45-185f-517f-8869-e3816e9c3130
2026-03-12 19:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128152)
2026-03-12 19:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a08d0>
2026-03-12 19:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/3.jpeg saved to cache
2026-03-12 19:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b011e45-185f-517f-8869-e3816e9c3130
2026-03-12 19:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128152)
2026-03-12 19:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7a250>
2026-03-12 19:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/2.jpeg saved to cache
2026-03-12 19:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b011e45-185f-517f-8869-e3816e9c3130
2026-03-12 19:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128152)
2026-03-12 19:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ab250>
2026-03-12 19:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/1.jpeg saved to cache
2026-03-12 19:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b011e45-185f-517f-8869-e3816e9c3130
2026-03-12 19:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128152)
2026-03-12 19:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedbb90>
2026-03-12 19:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/0.jpeg saved to cache
2026-03-12 19:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b011e45-185f-517f-8869-e3816e9c3130
2026-03-12 19:59:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b011e45-185f-517f-8869-e3816e9c3130, skipping ID generation
2026-03-12 19:59:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b011e45-185f-517f-8869-e3816e9c3130 with scrape type 1
2026-03-12 19:59:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b011e45-185f-517f-8869-e3816e9c3130 sending to next pipeline
2026-03-12 19:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 2b011e45-185f-517f-8869-e3816e9c3130, identifier: 128152
2026-03-12 19:59:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 2b011e45-185f-517f-8869-e3816e9c3130 with identifier: 128152
2026-03-12 19:59:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 2b011e45-185f-517f-8869-e3816e9c3130 with identifier: 128152
2026-03-12 19:59:38 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 2b011e45-185f-517f-8869-e3816e9c3130 with identifier: 128152 to the API
2026-03-12 19:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:59:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:59:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'engine_horse_power': 288,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': '2b011e45-185f-517f-8869-e3816e9c3130',
'is_damaged': False,
'is_operable': True,
'license_plate': 'HN22YPZ',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/bmw-3-series-saloon-special-editions-2019-330e-m-sport-pro-edition-4dr-step-auto-128152',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'BMW',
'model': '3 SERIES SALOON SPECIAL EDITIONS (2019)',
'odometer': 25469,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53615,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48261,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54157,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51469,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48891,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42805,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53678,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51760,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44262,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b011e45-185f-517f-8869-e3816e9c3130/2b011e45-185f-517f-8869-e3816e9c3130_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67717,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128152/9.jpeg',
'Width': 800}],
'price': 28000.0,
'price_includes_vat': True,
'registration_date': '2022-07-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3 SERIES SALOON SPECIAL EDITIONS (2019) 330e M Sport Pro '
'Edition 4dr Step Auto',
'transmission': 'automatic',
'trim': '330e M Sport Pro Edition 4dr Step Auto',
'vin': 'WBA5P52010FN22285',
'year': 2022}
2026-03-12 19:59:38 [arval.uk] INFO: Saving data for 128152: {'created_time': 1773345578.973472, 'last_price_update_time': 1773345578.973483}
2026-03-12 19:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123495)
2026-03-12 19:59:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762a210>
2026-03-12 19:59:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/9.jpeg saved to cache
2026-03-12 19:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5abf5a52-8e55-57e3-ba99-887239b34b9c
2026-03-12 19:59:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123495)
2026-03-12 19:59:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c1782d0>
2026-03-12 19:59:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/8.jpeg saved to cache
2026-03-12 19:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5abf5a52-8e55-57e3-ba99-887239b34b9c
2026-03-12 19:59:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123495)
2026-03-12 19:59:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f34110>
2026-03-12 19:59:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/7.jpeg saved to cache
2026-03-12 19:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5abf5a52-8e55-57e3-ba99-887239b34b9c
2026-03-12 19:59:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124651)
2026-03-12 19:59:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713fa50>
2026-03-12 19:59:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/9.jpeg saved to cache
2026-03-12 19:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ff4989f-1271-55b1-a950-9937ee035094
2026-03-12 19:59:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124651)
2026-03-12 19:59:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cba3750>
2026-03-12 19:59:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/8.jpeg saved to cache
2026-03-12 19:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ff4989f-1271-55b1-a950-9937ee035094
2026-03-12 19:59:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120953)
2026-03-12 19:59:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67629d10>
2026-03-12 19:59:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_9.jpg HTTP/1.1" 201 0
2026-03-12 19:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/9.jpeg saved to cache
2026-03-12 19:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cc4c98d-317b-5008-885b-4a11da4eb02a
2026-03-12 19:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120953)
2026-03-12 19:59:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b6110>
2026-03-12 19:59:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_8.jpg HTTP/1.1" 201 0
2026-03-12 19:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/8.jpeg saved to cache
2026-03-12 19:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cc4c98d-317b-5008-885b-4a11da4eb02a
2026-03-12 19:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120953)
2026-03-12 19:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676059d0>
2026-03-12 19:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/7.jpeg saved to cache
2026-03-12 19:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4cc4c98d-317b-5008-885b-4a11da4eb02a
2026-03-12 19:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120953)
2026-03-12 19:59:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718e190>
2026-03-12 19:59:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/6.jpeg saved to cache
2026-03-12 19:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cc4c98d-317b-5008-885b-4a11da4eb02a
2026-03-12 19:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120953)
2026-03-12 19:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a0050>
2026-03-12 19:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_5.jpg HTTP/1.1" 201 0
2026-03-12 19:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/5.jpeg saved to cache
2026-03-12 19:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cc4c98d-317b-5008-885b-4a11da4eb02a
2026-03-12 19:59:51 [scrapy.extensions.logstats] INFO: Crawled 51 pages (at 3 pages/min), scraped 18 items (at 5 items/min)
2026-03-12 19:59:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 19:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120953)
2026-03-12 19:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2e88d0>
2026-03-12 19:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_4.jpg HTTP/1.1" 201 0
2026-03-12 19:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/4.jpeg saved to cache
2026-03-12 19:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cc4c98d-317b-5008-885b-4a11da4eb02a
2026-03-12 19:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120953)
2026-03-12 19:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676067d0>
2026-03-12 19:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_3.jpg HTTP/1.1" 201 0
2026-03-12 19:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/3.jpeg saved to cache
2026-03-12 19:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cc4c98d-317b-5008-885b-4a11da4eb02a
2026-03-12 19:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120953)
2026-03-12 19:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2e8d10>
2026-03-12 19:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_2.jpg HTTP/1.1" 201 0
2026-03-12 19:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/2.jpeg saved to cache
2026-03-12 19:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cc4c98d-317b-5008-885b-4a11da4eb02a
2026-03-12 19:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120953)
2026-03-12 19:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18c5d0>
2026-03-12 19:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_1.jpg HTTP/1.1" 201 0
2026-03-12 19:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/1.jpeg saved to cache
2026-03-12 19:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cc4c98d-317b-5008-885b-4a11da4eb02a
2026-03-12 19:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120953)
2026-03-12 19:59:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67750050>
2026-03-12 19:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_0.jpg HTTP/1.1" 201 0
2026-03-12 19:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/0.jpeg saved to cache
2026-03-12 19:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cc4c98d-317b-5008-885b-4a11da4eb02a
2026-03-12 19:59:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cc4c98d-317b-5008-885b-4a11da4eb02a, skipping ID generation
2026-03-12 19:59:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc4c98d-317b-5008-885b-4a11da4eb02a with scrape type 1
2026-03-12 19:59:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cc4c98d-317b-5008-885b-4a11da4eb02a sending to next pipeline
2026-03-12 19:59:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 4cc4c98d-317b-5008-885b-4a11da4eb02a, identifier: 120953
2026-03-12 19:59:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 4cc4c98d-317b-5008-885b-4a11da4eb02a with identifier: 120953
2026-03-12 19:59:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 4cc4c98d-317b-5008-885b-4a11da4eb02a with identifier: 120953
2026-03-12 19:59:57 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 4cc4c98d-317b-5008-885b-4a11da4eb02a with identifier: 120953 to the API
2026-03-12 19:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 19:59:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 19:59:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '4cc4c98d-317b-5008-885b-4a11da4eb02a',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YD72CZJ',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-q3-estate-2018-35-tfsi-black-edition-5dr-s-tronic-120953',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'Q3 ESTATE (2018)',
'odometer': 19627,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76225,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69082,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83322,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58735,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46802,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77764,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73584,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54767,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 16129,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc4c98d-317b-5008-885b-4a11da4eb02a/4cc4c98d-317b-5008-885b-4a11da4eb02a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38004,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120953/9.jpeg',
'Width': 800}],
'price': 26200.0,
'price_includes_vat': True,
'registration_date': '2022-10-20',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 ESTATE (2018) 35 TFSI Black Edition 5dr S Tronic',
'transmission': 'automatic',
'trim': '35 TFSI Black Edition 5dr S Tronic',
'vin': 'WAUZZZF31N1139278',
'year': 2022}
2026-03-12 19:59:57 [arval.uk] INFO: Saving data for 120953: {'created_time': 1773345597.460378, 'last_price_update_time': 1773345597.460388}
2026-03-12 19:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124651)
2026-03-12 19:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66069c50>
2026-03-12 19:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_7.jpg HTTP/1.1" 201 0
2026-03-12 19:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/7.jpeg saved to cache
2026-03-12 19:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ff4989f-1271-55b1-a950-9937ee035094
2026-03-12 19:59:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/111513> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:59:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3767741a-7f8c-5d75-a6e3-b806a6b3812a with identifier: 111513
2026-03-12 19:59:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a with scrape type 1
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/0.jpeg not downloaded yet
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/1.jpeg not downloaded yet
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/2.jpeg not downloaded yet
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/3.jpeg not downloaded yet
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/4.jpeg not downloaded yet
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/5.jpeg not downloaded yet
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/6.jpeg not downloaded yet
2026-03-12 19:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124651)
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/7.jpeg not downloaded yet
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/8.jpeg not downloaded yet
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/9.jpeg not downloaded yet
2026-03-12 19:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 19:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762ad10>
2026-03-12 19:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 19:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 19:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 19:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_6.jpg HTTP/1.1" 201 0
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/6.jpeg saved to cache
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ff4989f-1271-55b1-a950-9937ee035094
2026-03-12 19:59:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 19:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128788> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 19:59:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1e09031-59b5-5084-a957-9d00ca0334ee with identifier: 128788
2026-03-12 19:59:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e09031-59b5-5084-a957-9d00ca0334ee with scrape type 1
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1e09031-59b5-5084-a957-9d00ca0334ee
2026-03-12 19:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/0.jpeg not downloaded yet
2026-03-12 20:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/1.jpeg not downloaded yet
2026-03-12 20:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/2.jpeg not downloaded yet
2026-03-12 20:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/3.jpeg not downloaded yet
2026-03-12 20:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/4.jpeg not downloaded yet
2026-03-12 20:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/5.jpeg not downloaded yet
2026-03-12 20:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/6.jpeg not downloaded yet
2026-03-12 20:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/7.jpeg not downloaded yet
2026-03-12 20:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/8.jpeg not downloaded yet
2026-03-12 20:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/9.jpeg not downloaded yet
2026-03-12 20:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124651)
2026-03-12 20:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660690d0>
2026-03-12 20:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/5.jpeg saved to cache
2026-03-12 20:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ff4989f-1271-55b1-a950-9937ee035094
2026-03-12 20:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116271> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:00:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d60033a8-c690-56ad-901a-f085ada24085 with identifier: 116271
2026-03-12 20:00:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d60033a8-c690-56ad-901a-f085ada24085 with scrape type 1
2026-03-12 20:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d60033a8-c690-56ad-901a-f085ada24085
2026-03-12 20:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/0.jpeg not downloaded yet
2026-03-12 20:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/1.jpeg not downloaded yet
2026-03-12 20:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/2.jpeg not downloaded yet
2026-03-12 20:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/3.jpeg not downloaded yet
2026-03-12 20:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/4.jpeg not downloaded yet
2026-03-12 20:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/5.jpeg not downloaded yet
2026-03-12 20:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/6.jpeg not downloaded yet
2026-03-12 20:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/7.jpeg not downloaded yet
2026-03-12 20:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/8.jpeg not downloaded yet
2026-03-12 20:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/9.jpeg not downloaded yet
2026-03-12 20:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124651)
2026-03-12 20:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb1a90>
2026-03-12 20:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/4.jpeg saved to cache
2026-03-12 20:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ff4989f-1271-55b1-a950-9937ee035094
2026-03-12 20:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124651)
2026-03-12 20:00:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607a890>
2026-03-12 20:00:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/3.jpeg saved to cache
2026-03-12 20:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ff4989f-1271-55b1-a950-9937ee035094
2026-03-12 20:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124651)
2026-03-12 20:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67680910>
2026-03-12 20:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/2.jpeg saved to cache
2026-03-12 20:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ff4989f-1271-55b1-a950-9937ee035094
2026-03-12 20:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124651)
2026-03-12 20:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66051ad0>
2026-03-12 20:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/1.jpeg saved to cache
2026-03-12 20:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ff4989f-1271-55b1-a950-9937ee035094
2026-03-12 20:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124651)
2026-03-12 20:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16c110>
2026-03-12 20:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/0.jpeg saved to cache
2026-03-12 20:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ff4989f-1271-55b1-a950-9937ee035094
2026-03-12 20:00:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ff4989f-1271-55b1-a950-9937ee035094, skipping ID generation
2026-03-12 20:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ff4989f-1271-55b1-a950-9937ee035094 with scrape type 1
2026-03-12 20:00:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ff4989f-1271-55b1-a950-9937ee035094 sending to next pipeline
2026-03-12 20:00:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 7ff4989f-1271-55b1-a950-9937ee035094, identifier: 124651
2026-03-12 20:00:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 7ff4989f-1271-55b1-a950-9937ee035094 with identifier: 124651
2026-03-12 20:00:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 7ff4989f-1271-55b1-a950-9937ee035094 with identifier: 124651
2026-03-12 20:00:06 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 7ff4989f-1271-55b1-a950-9937ee035094 with identifier: 124651 to the API
2026-03-12 20:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:00:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '7ff4989f-1271-55b1-a950-9937ee035094',
'is_damaged': False,
'is_operable': True,
'license_plate': 'WR73HVK',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-a4-avant-2019-35-tfsi-black-edition-5dr-s-tronic-124651',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'A4 AVANT (2019)',
'odometer': 10830,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79387,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78577,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72249,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72018,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78779,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75804,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83678,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66794,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98488,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7ff4989f-1271-55b1-a950-9937ee035094/7ff4989f-1271-55b1-a950-9937ee035094_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83682,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124651/9.jpeg',
'Width': 800}],
'price': 26400.0,
'price_includes_vat': True,
'registration_date': '2023-10-09',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 AVANT (2019) 35 TFSI Black Edition 5dr S Tronic',
'transmission': 'automatic',
'trim': '35 TFSI Black Edition 5dr S Tronic',
'vin': 'WAUZZZF42RA006687',
'year': 2023}
2026-03-12 20:00:06 [arval.uk] INFO: Saving data for 124651: {'created_time': 1773345606.880518, 'last_price_update_time': 1773345606.880529}
2026-03-12 20:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123495)
2026-03-12 20:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18fa50>
2026-03-12 20:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/6.jpeg saved to cache
2026-03-12 20:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5abf5a52-8e55-57e3-ba99-887239b34b9c
2026-03-12 20:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123495)
2026-03-12 20:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f35050>
2026-03-12 20:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/5.jpeg saved to cache
2026-03-12 20:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5abf5a52-8e55-57e3-ba99-887239b34b9c
2026-03-12 20:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123495)
2026-03-12 20:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778e3d0>
2026-03-12 20:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/4.jpeg saved to cache
2026-03-12 20:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5abf5a52-8e55-57e3-ba99-887239b34b9c
2026-03-12 20:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123495)
2026-03-12 20:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f34e50>
2026-03-12 20:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/3.jpeg saved to cache
2026-03-12 20:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5abf5a52-8e55-57e3-ba99-887239b34b9c
2026-03-12 20:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123495)
2026-03-12 20:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67707750>
2026-03-12 20:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/2.jpeg saved to cache
2026-03-12 20:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5abf5a52-8e55-57e3-ba99-887239b34b9c
2026-03-12 20:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123495)
2026-03-12 20:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778fed0>
2026-03-12 20:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/1.jpeg saved to cache
2026-03-12 20:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5abf5a52-8e55-57e3-ba99-887239b34b9c
2026-03-12 20:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123495)
2026-03-12 20:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677056d0>
2026-03-12 20:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/0.jpeg saved to cache
2026-03-12 20:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5abf5a52-8e55-57e3-ba99-887239b34b9c
2026-03-12 20:00:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5abf5a52-8e55-57e3-ba99-887239b34b9c, skipping ID generation
2026-03-12 20:00:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5abf5a52-8e55-57e3-ba99-887239b34b9c with scrape type 1
2026-03-12 20:00:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5abf5a52-8e55-57e3-ba99-887239b34b9c sending to next pipeline
2026-03-12 20:00:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 5abf5a52-8e55-57e3-ba99-887239b34b9c, identifier: 123495
2026-03-12 20:00:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 5abf5a52-8e55-57e3-ba99-887239b34b9c with identifier: 123495
2026-03-12 20:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 5abf5a52-8e55-57e3-ba99-887239b34b9c with identifier: 123495
2026-03-12 20:00:15 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 5abf5a52-8e55-57e3-ba99-887239b34b9c with identifier: 123495 to the API
2026-03-12 20:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:00:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 242,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '5abf5a52-8e55-57e3-ba99-887239b34b9c',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YD73ATV',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-20-tsi-gti-5dr-dsg-123495',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 29504,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60998,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60870,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56000,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47422,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50581,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166099,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103864,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124676,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92257,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5abf5a52-8e55-57e3-ba99-887239b34b9c/5abf5a52-8e55-57e3-ba99-887239b34b9c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99498,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123495/9.jpeg',
'Width': 1280}],
'price': 26500.0,
'price_includes_vat': True,
'registration_date': '2023-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 2.0 TSI GTI 5dr DSG',
'transmission': 'automatic',
'trim': '2.0 TSI GTI 5dr DSG',
'vin': 'WVWZZZCD1RW107231',
'year': 2023}
2026-03-12 20:00:15 [arval.uk] INFO: Saving data for 123495: {'created_time': 1773345615.475488, 'last_price_update_time': 1773345615.475496}
2026-03-12 20:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/111513)
2026-03-12 20:00:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67179750>
2026-03-12 20:00:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/6.jpeg saved to cache
2026-03-12 20:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a
2026-03-12 20:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/111513)
2026-03-12 20:00:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16fcd0>
2026-03-12 20:00:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/9.jpeg saved to cache
2026-03-12 20:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a
2026-03-12 20:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128788)
2026-03-12 20:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67750650>
2026-03-12 20:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/9.jpeg saved to cache
2026-03-12 20:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1e09031-59b5-5084-a957-9d00ca0334ee
2026-03-12 20:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128788)
2026-03-12 20:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a88d0>
2026-03-12 20:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/8.jpeg saved to cache
2026-03-12 20:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f1e09031-59b5-5084-a957-9d00ca0334ee
2026-03-12 20:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116271)
2026-03-12 20:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18c6d0>
2026-03-12 20:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/9.jpeg saved to cache
2026-03-12 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d60033a8-c690-56ad-901a-f085ada24085
2026-03-12 20:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116271)
2026-03-12 20:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a8e90>
2026-03-12 20:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/8.jpeg saved to cache
2026-03-12 20:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d60033a8-c690-56ad-901a-f085ada24085
2026-03-12 20:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116271)
2026-03-12 20:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18ebd0>
2026-03-12 20:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/7.jpeg saved to cache
2026-03-12 20:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d60033a8-c690-56ad-901a-f085ada24085
2026-03-12 20:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116271)
2026-03-12 20:00:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778fe90>
2026-03-12 20:00:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/6.jpeg saved to cache
2026-03-12 20:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d60033a8-c690-56ad-901a-f085ada24085
2026-03-12 20:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116271)
2026-03-12 20:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66096a90>
2026-03-12 20:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/5.jpeg saved to cache
2026-03-12 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d60033a8-c690-56ad-901a-f085ada24085
2026-03-12 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116271)
2026-03-12 20:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66051fd0>
2026-03-12 20:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/4.jpeg saved to cache
2026-03-12 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d60033a8-c690-56ad-901a-f085ada24085
2026-03-12 20:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116271)
2026-03-12 20:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7a8d0>
2026-03-12 20:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/3.jpeg saved to cache
2026-03-12 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d60033a8-c690-56ad-901a-f085ada24085
2026-03-12 20:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116271)
2026-03-12 20:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67770c10>
2026-03-12 20:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/2.jpeg saved to cache
2026-03-12 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d60033a8-c690-56ad-901a-f085ada24085
2026-03-12 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116271)
2026-03-12 20:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f78890>
2026-03-12 20:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/1.jpeg saved to cache
2026-03-12 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d60033a8-c690-56ad-901a-f085ada24085
2026-03-12 20:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116271)
2026-03-12 20:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778cd50>
2026-03-12 20:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/0.jpeg saved to cache
2026-03-12 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d60033a8-c690-56ad-901a-f085ada24085
2026-03-12 20:00:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d60033a8-c690-56ad-901a-f085ada24085, skipping ID generation
2026-03-12 20:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d60033a8-c690-56ad-901a-f085ada24085 with scrape type 1
2026-03-12 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d60033a8-c690-56ad-901a-f085ada24085 sending to next pipeline
2026-03-12 20:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: d60033a8-c690-56ad-901a-f085ada24085, identifier: 116271
2026-03-12 20:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: d60033a8-c690-56ad-901a-f085ada24085 with identifier: 116271
2026-03-12 20:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: d60033a8-c690-56ad-901a-f085ada24085 with identifier: 116271
2026-03-12 20:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: d60033a8-c690-56ad-901a-f085ada24085 with identifier: 116271 to the API
2026-03-12 20:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:00:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 227,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': 'd60033a8-c690-56ad-901a-f085ada24085',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BW22DHY',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-santa-fe-estate-2021-16-tgdi-hybrid-premium-5dr-auto-116271',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Hyundai',
'model': 'SANTA FE ESTATE (2021)',
'odometer': 19293,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 56,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54350,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50613,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51721,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50710,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49379,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43078,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50308,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52090,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83804,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60033a8-c690-56ad-901a-f085ada24085/d60033a8-c690-56ad-901a-f085ada24085_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40919,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116271/9.jpeg',
'Width': 800}],
'price': 25600.0,
'price_includes_vat': True,
'registration_date': '2022-08-08',
'seats_number': 7,
'seller_name': None,
'title': 'Hyundai SANTA FE ESTATE (2021) 1.6 TGDi Hybrid Premium 5dr Auto',
'transmission': 'automatic',
'trim': '1.6 TGDi Hybrid Premium 5dr Auto',
'vin': 'KMHS3811MNU048445',
'year': 2022}
2026-03-12 20:00:31 [arval.uk] INFO: Saving data for 116271: {'created_time': 1773345631.812313, 'last_price_update_time': 1773345631.812323}
2026-03-12 20:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128788)
2026-03-12 20:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660644d0>
2026-03-12 20:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/7.jpeg saved to cache
2026-03-12 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f1e09031-59b5-5084-a957-9d00ca0334ee
2026-03-12 20:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128788)
2026-03-12 20:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66079f90>
2026-03-12 20:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/6.jpeg saved to cache
2026-03-12 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f1e09031-59b5-5084-a957-9d00ca0334ee
2026-03-12 20:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128788)
2026-03-12 20:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a7190>
2026-03-12 20:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/5.jpeg saved to cache
2026-03-12 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f1e09031-59b5-5084-a957-9d00ca0334ee
2026-03-12 20:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127035> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1beb43df-097f-5e7d-8338-6d9ba62d5b7b with identifier: 127035
2026-03-12 20:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b with scrape type 1
2026-03-12 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b
2026-03-12 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/0.jpeg not downloaded yet
2026-03-12 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/1.jpeg not downloaded yet
2026-03-12 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/2.jpeg not downloaded yet
2026-03-12 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/3.jpeg not downloaded yet
2026-03-12 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/4.jpeg not downloaded yet
2026-03-12 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/5.jpeg not downloaded yet
2026-03-12 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/6.jpeg not downloaded yet
2026-03-12 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/7.jpeg not downloaded yet
2026-03-12 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/8.jpeg not downloaded yet
2026-03-12 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/9.jpeg not downloaded yet
2026-03-12 20:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128788)
2026-03-12 20:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67751d90>
2026-03-12 20:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/4.jpeg saved to cache
2026-03-12 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1e09031-59b5-5084-a957-9d00ca0334ee
2026-03-12 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130271> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0b5c6c0-b744-5392-9884-6070b69e7f5e with identifier: 130271
2026-03-12 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b5c6c0-b744-5392-9884-6070b69e7f5e with scrape type 1
2026-03-12 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0b5c6c0-b744-5392-9884-6070b69e7f5e
2026-03-12 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/0.jpeg not downloaded yet
2026-03-12 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/1.jpeg not downloaded yet
2026-03-12 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/2.jpeg not downloaded yet
2026-03-12 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/3.jpeg not downloaded yet
2026-03-12 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/4.jpeg not downloaded yet
2026-03-12 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/5.jpeg not downloaded yet
2026-03-12 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/6.jpeg not downloaded yet
2026-03-12 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/7.jpeg not downloaded yet
2026-03-12 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/8.jpeg not downloaded yet
2026-03-12 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/9.jpeg not downloaded yet
2026-03-12 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128788)
2026-03-12 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123714> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6da2ed90>
2026-03-12 20:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/3.jpeg saved to cache
2026-03-12 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1e09031-59b5-5084-a957-9d00ca0334ee
2026-03-12 20:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0 with identifier: 123714
2026-03-12 20:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0 with scrape type 1
2026-03-12 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0
2026-03-12 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/0.jpeg not downloaded yet
2026-03-12 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/1.jpeg not downloaded yet
2026-03-12 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/2.jpeg not downloaded yet
2026-03-12 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/3.jpeg not downloaded yet
2026-03-12 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/4.jpeg not downloaded yet
2026-03-12 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/5.jpeg not downloaded yet
2026-03-12 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/6.jpeg not downloaded yet
2026-03-12 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/7.jpeg not downloaded yet
2026-03-12 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/8.jpeg not downloaded yet
2026-03-12 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/9.jpeg not downloaded yet
2026-03-12 20:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128788)
2026-03-12 20:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67144d50>
2026-03-12 20:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/2.jpeg saved to cache
2026-03-12 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f1e09031-59b5-5084-a957-9d00ca0334ee
2026-03-12 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128788)
2026-03-12 20:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16c650>
2026-03-12 20:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/1.jpeg saved to cache
2026-03-12 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1e09031-59b5-5084-a957-9d00ca0334ee
2026-03-12 20:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129478> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43fa2f07-c2bb-541c-85f3-fd620fa70af7 with identifier: 129478
2026-03-12 20:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7 with scrape type 1
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/0.jpeg not downloaded yet
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/1.jpeg not downloaded yet
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/2.jpeg not downloaded yet
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/3.jpeg not downloaded yet
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/4.jpeg not downloaded yet
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/5.jpeg not downloaded yet
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/6.jpeg not downloaded yet
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/7.jpeg not downloaded yet
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/8.jpeg not downloaded yet
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/9.jpeg not downloaded yet
2026-03-12 20:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128788)
2026-03-12 20:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67179010>
2026-03-12 20:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/0.jpeg saved to cache
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1e09031-59b5-5084-a957-9d00ca0334ee
2026-03-12 20:00:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1e09031-59b5-5084-a957-9d00ca0334ee, skipping ID generation
2026-03-12 20:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e09031-59b5-5084-a957-9d00ca0334ee with scrape type 1
2026-03-12 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1e09031-59b5-5084-a957-9d00ca0334ee sending to next pipeline
2026-03-12 20:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: f1e09031-59b5-5084-a957-9d00ca0334ee, identifier: 128788
2026-03-12 20:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: f1e09031-59b5-5084-a957-9d00ca0334ee with identifier: 128788
2026-03-12 20:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: f1e09031-59b5-5084-a957-9d00ca0334ee with identifier: 128788
2026-03-12 20:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: f1e09031-59b5-5084-a957-9d00ca0334ee with identifier: 128788 to the API
2026-03-12 20:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:00:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 281,
'expiration_date': None,
'fuel_type': 'Electric',
'id': 'f1e09031-59b5-5084-a957-9d00ca0334ee',
'is_damaged': False,
'is_operable': True,
'license_plate': 'LP71OKX',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/bmw-ix3-electric-estate-2021-210kw-m-sport-80kwh-5dr-auto-128788',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'BMW',
'model': 'iX3 ELECTRIC ESTATE (2021)',
'odometer': 21043,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54902,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50804,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58773,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54751,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55745,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44322,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55420,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54279,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36935,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1e09031-59b5-5084-a957-9d00ca0334ee/f1e09031-59b5-5084-a957-9d00ca0334ee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48571,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128788/9.jpeg',
'Width': 800}],
'price': 25900.0,
'price_includes_vat': True,
'registration_date': '2022-02-17',
'seats_number': 5,
'seller_name': None,
'title': 'BMW iX3 ELECTRIC ESTATE (2021) 210kW M Sport 80kWh 5dr Auto',
'transmission': 'automatic',
'trim': '210kW M Sport 80kWh 5dr Auto',
'vin': 'WBY42DU050S265366',
'year': 2022}
2026-03-12 20:00:42 [arval.uk] INFO: Saving data for 128788: {'created_time': 1773345642.204949, 'last_price_update_time': 1773345642.204958}
2026-03-12 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/111513)
2026-03-12 20:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778fb10>
2026-03-12 20:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/8.jpeg saved to cache
2026-03-12 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a
2026-03-12 20:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/111513)
2026-03-12 20:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676115d0>
2026-03-12 20:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/7.jpeg saved to cache
2026-03-12 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a
2026-03-12 20:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/111513)
2026-03-12 20:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66025510>
2026-03-12 20:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/5.jpeg saved to cache
2026-03-12 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a
2026-03-12 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/111513)
2026-03-12 20:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67765c50>
2026-03-12 20:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/4.jpeg saved to cache
2026-03-12 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a
2026-03-12 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/111513)
2026-03-12 20:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677e8d90>
2026-03-12 20:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/3.jpeg saved to cache
2026-03-12 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a
2026-03-12 20:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/111513)
2026-03-12 20:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677383d0>
2026-03-12 20:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/2.jpeg saved to cache
2026-03-12 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a
2026-03-12 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/111513)
2026-03-12 20:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67647bd0>
2026-03-12 20:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/1.jpeg saved to cache
2026-03-12 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a
2026-03-12 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/111513)
2026-03-12 20:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66068f50>
2026-03-12 20:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/0.jpeg saved to cache
2026-03-12 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a
2026-03-12 20:00:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3767741a-7f8c-5d75-a6e3-b806a6b3812a, skipping ID generation
2026-03-12 20:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a with scrape type 1
2026-03-12 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3767741a-7f8c-5d75-a6e3-b806a6b3812a sending to next pipeline
2026-03-12 20:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 3767741a-7f8c-5d75-a6e3-b806a6b3812a, identifier: 111513
2026-03-12 20:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 3767741a-7f8c-5d75-a6e3-b806a6b3812a with identifier: 111513
2026-03-12 20:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 3767741a-7f8c-5d75-a6e3-b806a6b3812a with identifier: 111513
2026-03-12 20:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 3767741a-7f8c-5d75-a6e3-b806a6b3812a with identifier: 111513 to the API
2026-03-12 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:00:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 227,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': '3767741a-7f8c-5d75-a6e3-b806a6b3812a',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DS22WRX',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-santa-fe-estate-2021-16-tgdi-hybrid-premium-5dr-auto-111513',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Hyundai',
'model': 'SANTA FE ESTATE (2021)',
'odometer': 14671,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74192,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80759,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94965,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77216,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76430,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72132,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83700,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64026,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 17657,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3767741a-7f8c-5d75-a6e3-b806a6b3812a/3767741a-7f8c-5d75-a6e3-b806a6b3812a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56622,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/111513/9.jpeg',
'Width': 800}],
'price': 26200.0,
'price_includes_vat': True,
'registration_date': '2022-06-27',
'seats_number': 7,
'seller_name': None,
'title': 'Hyundai SANTA FE ESTATE (2021) 1.6 TGDi Hybrid Premium 5dr Auto',
'transmission': 'automatic',
'trim': '1.6 TGDi Hybrid Premium 5dr Auto',
'vin': 'KMHS3811MNU044915',
'year': 2022}
2026-03-12 20:00:50 [arval.uk] INFO: Saving data for 111513: {'created_time': 1773345650.556026, 'last_price_update_time': 1773345650.556035}
2026-03-12 20:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127035)
2026-03-12 20:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676136d0>
2026-03-12 20:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/9.jpeg saved to cache
2026-03-12 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b
2026-03-12 20:00:51 [scrapy.extensions.logstats] INFO: Crawled 58 pages (at 7 pages/min), scraped 24 items (at 6 items/min)
2026-03-12 20:00:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127035)
2026-03-12 20:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67632510>
2026-03-12 20:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/8.jpeg saved to cache
2026-03-12 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b
2026-03-12 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130271)
2026-03-12 20:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67615f10>
2026-03-12 20:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/9.jpeg saved to cache
2026-03-12 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0b5c6c0-b744-5392-9884-6070b69e7f5e
2026-03-12 20:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130271)
2026-03-12 20:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66050d50>
2026-03-12 20:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/8.jpeg saved to cache
2026-03-12 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0b5c6c0-b744-5392-9884-6070b69e7f5e
2026-03-12 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123714)
2026-03-12 20:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c12f2d0>
2026-03-12 20:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/9.jpeg saved to cache
2026-03-12 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0
2026-03-12 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123714)
2026-03-12 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbe4190>
2026-03-12 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/8.jpeg saved to cache
2026-03-12 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0
2026-03-12 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123714)
2026-03-12 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676325d0>
2026-03-12 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/7.jpeg saved to cache
2026-03-12 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0
2026-03-12 20:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129478)
2026-03-12 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763a410>
2026-03-12 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/9.jpeg saved to cache
2026-03-12 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7
2026-03-12 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129478)
2026-03-12 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607bb50>
2026-03-12 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/8.jpeg saved to cache
2026-03-12 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7
2026-03-12 20:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129478)
2026-03-12 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66026ad0>
2026-03-12 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/7.jpeg saved to cache
2026-03-12 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7
2026-03-12 20:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129478)
2026-03-12 20:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67612750>
2026-03-12 20:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/6.jpeg saved to cache
2026-03-12 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7
2026-03-12 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129478)
2026-03-12 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66068050>
2026-03-12 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/5.jpeg saved to cache
2026-03-12 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7
2026-03-12 20:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129478)
2026-03-12 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a5590>
2026-03-12 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/4.jpeg saved to cache
2026-03-12 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7
2026-03-12 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129478)
2026-03-12 20:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa390>
2026-03-12 20:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/3.jpeg saved to cache
2026-03-12 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7
2026-03-12 20:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129478)
2026-03-12 20:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676127d0>
2026-03-12 20:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/2.jpeg saved to cache
2026-03-12 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7
2026-03-12 20:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129478)
2026-03-12 20:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbed790>
2026-03-12 20:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/1.jpeg saved to cache
2026-03-12 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7
2026-03-12 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129478)
2026-03-12 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67139710>
2026-03-12 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/0.jpeg saved to cache
2026-03-12 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7
2026-03-12 20:01:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43fa2f07-c2bb-541c-85f3-fd620fa70af7, skipping ID generation
2026-03-12 20:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7 with scrape type 1
2026-03-12 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43fa2f07-c2bb-541c-85f3-fd620fa70af7 sending to next pipeline
2026-03-12 20:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 43fa2f07-c2bb-541c-85f3-fd620fa70af7, identifier: 129478
2026-03-12 20:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 43fa2f07-c2bb-541c-85f3-fd620fa70af7 with identifier: 129478
2026-03-12 20:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 43fa2f07-c2bb-541c-85f3-fd620fa70af7 with identifier: 129478
2026-03-12 20:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 43fa2f07-c2bb-541c-85f3-fd620fa70af7 with identifier: 129478 to the API
2026-03-12 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:01:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 334,
'expiration_date': None,
'fuel_type': 'Electric',
'id': '43fa2f07-c2bb-541c-85f3-fd620fa70af7',
'is_damaged': False,
'is_operable': True,
'license_plate': 'NK72MWW',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/bmw-i4-gran-coupe-2021-250kw-edrive40-m-sport-839kwh-5dr-auto-129478',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'BMW',
'model': 'I4 GRAN COUPE (2021)',
'odometer': 27189,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70806,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82846,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84856,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68223,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82687,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72089,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84012,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83593,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116808,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43fa2f07-c2bb-541c-85f3-fd620fa70af7/43fa2f07-c2bb-541c-85f3-fd620fa70af7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74412,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129478/9.jpeg',
'Width': 800}],
'price': 25500.0,
'price_includes_vat': True,
'registration_date': '2022-09-04',
'seats_number': 5,
'seller_name': None,
'title': 'BMW I4 GRAN COUPE (2021) 250kW eDrive40 M Sport 83.9kWh 5dr Auto',
'transmission': 'automatic',
'trim': '250kW eDrive40 M Sport 83.9kWh 5dr Auto',
'vin': 'WBY72AW030FN11199',
'year': 2022}
2026-03-12 20:01:11 [arval.uk] INFO: Saving data for 129478: {'created_time': 1773345671.65741, 'last_price_update_time': 1773345671.65742}
2026-03-12 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123714)
2026-03-12 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67638c50>
2026-03-12 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/6.jpeg saved to cache
2026-03-12 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0
2026-03-12 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123714)
2026-03-12 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a8690>
2026-03-12 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/5.jpeg saved to cache
2026-03-12 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0
2026-03-12 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123714)
2026-03-12 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607a890>
2026-03-12 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/4.jpeg saved to cache
2026-03-12 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0
2026-03-12 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123714)
2026-03-12 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67628810>
2026-03-12 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/3.jpeg saved to cache
2026-03-12 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0
2026-03-12 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123714)
2026-03-12 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67606850>
2026-03-12 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/2.jpeg saved to cache
2026-03-12 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0
2026-03-12 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123714)
2026-03-12 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763b790>
2026-03-12 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/1.jpeg saved to cache
2026-03-12 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0
2026-03-12 20:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123714)
2026-03-12 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef1590>
2026-03-12 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/0.jpeg saved to cache
2026-03-12 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0
2026-03-12 20:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0, skipping ID generation
2026-03-12 20:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0 with scrape type 1
2026-03-12 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0 sending to next pipeline
2026-03-12 20:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0, identifier: 123714
2026-03-12 20:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0 with identifier: 123714
2026-03-12 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0 with identifier: 123714
2026-03-12 20:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 68f7d457-d3d5-58c6-82d4-bd68bb26c0c0 with identifier: 123714 to the API
2026-03-12 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:01:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '68f7d457-d3d5-58c6-82d4-bd68bb26c0c0',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YD72CYO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-q3-estate-2018-35-tfsi-black-edition-5dr-s-tronic-123714',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'Q3 ESTATE (2018)',
'odometer': 36689,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 45,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69806,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68020,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75136,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64664,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44899,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76723,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75438,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54191,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 16232,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f7d457-d3d5-58c6-82d4-bd68bb26c0c0/68f7d457-d3d5-58c6-82d4-bd68bb26c0c0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39513,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123714/9.jpeg',
'Width': 800}],
'price': 24800.0,
'price_includes_vat': True,
'registration_date': '2022-10-19',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 ESTATE (2018) 35 TFSI Black Edition 5dr S Tronic',
'transmission': 'automatic',
'trim': '35 TFSI Black Edition 5dr S Tronic',
'vin': 'WAUZZZF33N1123194',
'year': 2022}
2026-03-12 20:01:20 [arval.uk] INFO: Saving data for 123714: {'created_time': 1773345680.147295, 'last_price_update_time': 1773345680.147305}
2026-03-12 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130271)
2026-03-12 20:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66027790>
2026-03-12 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/7.jpeg saved to cache
2026-03-12 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0b5c6c0-b744-5392-9884-6070b69e7f5e
2026-03-12 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130271)
2026-03-12 20:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127511> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718d490>
2026-03-12 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/6.jpeg saved to cache
2026-03-12 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0b5c6c0-b744-5392-9884-6070b69e7f5e
2026-03-12 20:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3263eb3-4a1e-512d-8c33-7dd31039698e with identifier: 127511
2026-03-12 20:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3263eb3-4a1e-512d-8c33-7dd31039698e with scrape type 1
2026-03-12 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3263eb3-4a1e-512d-8c33-7dd31039698e
2026-03-12 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/0.jpeg not downloaded yet
2026-03-12 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/1.jpeg not downloaded yet
2026-03-12 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/2.jpeg not downloaded yet
2026-03-12 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/3.jpeg not downloaded yet
2026-03-12 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/4.jpeg not downloaded yet
2026-03-12 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/5.jpeg not downloaded yet
2026-03-12 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/6.jpeg not downloaded yet
2026-03-12 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/7.jpeg not downloaded yet
2026-03-12 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/8.jpeg not downloaded yet
2026-03-12 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/9.jpeg not downloaded yet
2026-03-12 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130271)
2026-03-12 20:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660512d0>
2026-03-12 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/5.jpeg saved to cache
2026-03-12 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0b5c6c0-b744-5392-9884-6070b69e7f5e
2026-03-12 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127914> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0524e448-6aa6-5c6b-8abe-9d7074723169 with identifier: 127914
2026-03-12 20:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0524e448-6aa6-5c6b-8abe-9d7074723169 with scrape type 1
2026-03-12 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0524e448-6aa6-5c6b-8abe-9d7074723169
2026-03-12 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/0.jpeg not downloaded yet
2026-03-12 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/1.jpeg not downloaded yet
2026-03-12 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/2.jpeg not downloaded yet
2026-03-12 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/3.jpeg not downloaded yet
2026-03-12 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/4.jpeg not downloaded yet
2026-03-12 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/5.jpeg not downloaded yet
2026-03-12 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/6.jpeg not downloaded yet
2026-03-12 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/7.jpeg not downloaded yet
2026-03-12 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/8.jpeg not downloaded yet
2026-03-12 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/9.jpeg not downloaded yet
2026-03-12 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130271)
2026-03-12 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66053450>
2026-03-12 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/4.jpeg saved to cache
2026-03-12 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0b5c6c0-b744-5392-9884-6070b69e7f5e
2026-03-12 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127955> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41fe926c-0ba7-52bd-b5b4-34e02e7f994c with identifier: 127955
2026-03-12 20:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c with scrape type 1
2026-03-12 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c
2026-03-12 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/0.jpeg not downloaded yet
2026-03-12 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/1.jpeg not downloaded yet
2026-03-12 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/2.jpeg not downloaded yet
2026-03-12 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/3.jpeg not downloaded yet
2026-03-12 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/4.jpeg not downloaded yet
2026-03-12 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/5.jpeg not downloaded yet
2026-03-12 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/6.jpeg not downloaded yet
2026-03-12 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/7.jpeg not downloaded yet
2026-03-12 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/8.jpeg not downloaded yet
2026-03-12 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/9.jpeg not downloaded yet
2026-03-12 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130271)
2026-03-12 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6d4fc350>
2026-03-12 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/3.jpeg saved to cache
2026-03-12 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0b5c6c0-b744-5392-9884-6070b69e7f5e
2026-03-12 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130271)
2026-03-12 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67120e90>
2026-03-12 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/2.jpeg saved to cache
2026-03-12 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0b5c6c0-b744-5392-9884-6070b69e7f5e
2026-03-12 20:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130271)
2026-03-12 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67705010>
2026-03-12 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/1.jpeg saved to cache
2026-03-12 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0b5c6c0-b744-5392-9884-6070b69e7f5e
2026-03-12 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130271)
2026-03-12 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67146550>
2026-03-12 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/0.jpeg saved to cache
2026-03-12 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0b5c6c0-b744-5392-9884-6070b69e7f5e
2026-03-12 20:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0b5c6c0-b744-5392-9884-6070b69e7f5e, skipping ID generation
2026-03-12 20:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b5c6c0-b744-5392-9884-6070b69e7f5e with scrape type 1
2026-03-12 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0b5c6c0-b744-5392-9884-6070b69e7f5e sending to next pipeline
2026-03-12 20:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: b0b5c6c0-b744-5392-9884-6070b69e7f5e, identifier: 130271
2026-03-12 20:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: b0b5c6c0-b744-5392-9884-6070b69e7f5e with identifier: 130271
2026-03-12 20:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: b0b5c6c0-b744-5392-9884-6070b69e7f5e with identifier: 130271
2026-03-12 20:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: b0b5c6c0-b744-5392-9884-6070b69e7f5e with identifier: 130271 to the API
2026-03-12 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:01:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 227,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': 'b0b5c6c0-b744-5392-9884-6070b69e7f5e',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DV72FXL',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-tucson-estate-2020-16-tgdi-hybrid-230-ultimate-5dr-2wd-auto-130271',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Hyundai',
'model': 'TUCSON ESTATE (2020)',
'odometer': 14980,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54692,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49233,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56359,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55082,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56035,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43156,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56986,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51491,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66679,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0b5c6c0-b744-5392-9884-6070b69e7f5e/b0b5c6c0-b744-5392-9884-6070b69e7f5e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69204,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130271/9.jpeg',
'Width': 800}],
'price': 25200.0,
'price_includes_vat': True,
'registration_date': '2023-01-22',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai TUCSON ESTATE (2020) 1.6 TGDi Hybrid 230 Ultimate 5dr 2WD '
'Auto',
'transmission': 'automatic',
'trim': '1.6 TGDi Hybrid 230 Ultimate 5dr 2WD Auto',
'vin': 'TMAJE811MPJ156445',
'year': 2023}
2026-03-12 20:01:30 [arval.uk] INFO: Saving data for 130271: {'created_time': 1773345690.255682, 'last_price_update_time': 1773345690.255691}
2026-03-12 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127035)
2026-03-12 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f8610>
2026-03-12 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/7.jpeg saved to cache
2026-03-12 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b
2026-03-12 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127035)
2026-03-12 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66052950>
2026-03-12 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/6.jpeg saved to cache
2026-03-12 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b
2026-03-12 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127035)
2026-03-12 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f37ed0>
2026-03-12 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/5.jpeg saved to cache
2026-03-12 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b
2026-03-12 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127035)
2026-03-12 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c116410>
2026-03-12 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/4.jpeg saved to cache
2026-03-12 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b
2026-03-12 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127035)
2026-03-12 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a4950>
2026-03-12 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/3.jpeg saved to cache
2026-03-12 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b
2026-03-12 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127035)
2026-03-12 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f37890>
2026-03-12 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/2.jpeg saved to cache
2026-03-12 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b
2026-03-12 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127035)
2026-03-12 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66025510>
2026-03-12 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/1.jpeg saved to cache
2026-03-12 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b
2026-03-12 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127035)
2026-03-12 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66079450>
2026-03-12 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/0.jpeg saved to cache
2026-03-12 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b
2026-03-12 20:01:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1beb43df-097f-5e7d-8338-6d9ba62d5b7b, skipping ID generation
2026-03-12 20:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b with scrape type 1
2026-03-12 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1beb43df-097f-5e7d-8338-6d9ba62d5b7b sending to next pipeline
2026-03-12 20:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 1beb43df-097f-5e7d-8338-6d9ba62d5b7b, identifier: 127035
2026-03-12 20:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 1beb43df-097f-5e7d-8338-6d9ba62d5b7b with identifier: 127035
2026-03-12 20:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 1beb43df-097f-5e7d-8338-6d9ba62d5b7b with identifier: 127035
2026-03-12 20:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 1beb43df-097f-5e7d-8338-6d9ba62d5b7b with identifier: 127035 to the API
2026-03-12 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:01:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 305,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': '1beb43df-097f-5e7d-8338-6d9ba62d5b7b',
'is_damaged': False,
'is_operable': True,
'license_plate': 'RF71EUM',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/land-rover-discovery-sport-sw-2019-15-p300e-r-dynamic-hse-5dr-auto-5-seat-127035',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Land Rover',
'model': 'DISCOVERY SPORT SW (2019)',
'odometer': 32118,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89700,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85859,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100440,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77614,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88564,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95480,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88692,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68558,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85941,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1beb43df-097f-5e7d-8338-6d9ba62d5b7b/1beb43df-097f-5e7d-8338-6d9ba62d5b7b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67235,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127035/9.jpeg',
'Width': 800}],
'price': 25400.0,
'price_includes_vat': True,
'registration_date': '2022-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover DISCOVERY SPORT SW (2019) 1.5 P300e R-Dynamic HSE 5dr '
'Auto [5 Seat]',
'transmission': 'automatic',
'trim': '1.5 P300e R-Dynamic HSE 5dr Auto [5 Seat]',
'vin': 'SALCA2ATXNH911999',
'year': 2022}
2026-03-12 20:01:40 [arval.uk] INFO: Saving data for 127035: {'created_time': 1773345700.462538, 'last_price_update_time': 1773345700.462548}
2026-03-12 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127511)
2026-03-12 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717ad10>
2026-03-12 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/9.jpeg saved to cache
2026-03-12 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3263eb3-4a1e-512d-8c33-7dd31039698e
2026-03-12 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127511)
2026-03-12 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607add0>
2026-03-12 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/8.jpeg saved to cache
2026-03-12 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3263eb3-4a1e-512d-8c33-7dd31039698e
2026-03-12 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127914)
2026-03-12 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f35050>
2026-03-12 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/9.jpeg saved to cache
2026-03-12 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0524e448-6aa6-5c6b-8abe-9d7074723169
2026-03-12 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127914)
2026-03-12 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c117b10>
2026-03-12 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/8.jpeg saved to cache
2026-03-12 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0524e448-6aa6-5c6b-8abe-9d7074723169
2026-03-12 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127955)
2026-03-12 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766e9d0>
2026-03-12 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/9.jpeg saved to cache
2026-03-12 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c
2026-03-12 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127955)
2026-03-12 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762b310>
2026-03-12 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/8.jpeg saved to cache
2026-03-12 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c
2026-03-12 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127955)
2026-03-12 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717b1d0>
2026-03-12 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/7.jpeg saved to cache
2026-03-12 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c
2026-03-12 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127955)
2026-03-12 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67123ed0>
2026-03-12 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/6.jpeg saved to cache
2026-03-12 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c
2026-03-12 20:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127955)
2026-03-12 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713d050>
2026-03-12 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/5.jpeg saved to cache
2026-03-12 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c
2026-03-12 20:01:51 [scrapy.extensions.logstats] INFO: Crawled 61 pages (at 3 pages/min), scraped 28 items (at 4 items/min)
2026-03-12 20:01:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127955)
2026-03-12 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67121610>
2026-03-12 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/4.jpeg saved to cache
2026-03-12 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c
2026-03-12 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127955)
2026-03-12 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16ea10>
2026-03-12 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/3.jpeg saved to cache
2026-03-12 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c
2026-03-12 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127955)
2026-03-12 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67707510>
2026-03-12 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/2.jpeg saved to cache
2026-03-12 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c
2026-03-12 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127955)
2026-03-12 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67645150>
2026-03-12 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/1.jpeg saved to cache
2026-03-12 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c
2026-03-12 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127955)
2026-03-12 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef2750>
2026-03-12 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/0.jpeg saved to cache
2026-03-12 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c
2026-03-12 20:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41fe926c-0ba7-52bd-b5b4-34e02e7f994c, skipping ID generation
2026-03-12 20:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c with scrape type 1
2026-03-12 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41fe926c-0ba7-52bd-b5b4-34e02e7f994c sending to next pipeline
2026-03-12 20:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 41fe926c-0ba7-52bd-b5b4-34e02e7f994c, identifier: 127955
2026-03-12 20:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 41fe926c-0ba7-52bd-b5b4-34e02e7f994c with identifier: 127955
2026-03-12 20:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 41fe926c-0ba7-52bd-b5b4-34e02e7f994c with identifier: 127955
2026-03-12 20:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 41fe926c-0ba7-52bd-b5b4-34e02e7f994c with identifier: 127955 to the API
2026-03-12 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:01:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 227,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': '41fe926c-0ba7-52bd-b5b4-34e02e7f994c',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DU23AXP',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-tucson-estate-2020-16-tgdi-hybrid-230-n-line-s-5dr-2wd-auto-127955',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Hyundai',
'model': 'TUCSON ESTATE (2020)',
'odometer': 23336,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100827,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76499,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104708,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110688,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105272,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79113,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102091,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102060,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70351,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41fe926c-0ba7-52bd-b5b4-34e02e7f994c/41fe926c-0ba7-52bd-b5b4-34e02e7f994c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96127,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127955/9.jpeg',
'Width': 800}],
'price': 23700.0,
'price_includes_vat': True,
'registration_date': '2023-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai TUCSON ESTATE (2020) 1.6 TGDi Hybrid 230 N Line S 5dr 2WD '
'Auto',
'transmission': 'automatic',
'trim': '1.6 TGDi Hybrid 230 N Line S 5dr 2WD Auto',
'vin': 'TMAJB811MNJ132778',
'year': 2023}
2026-03-12 20:01:58 [arval.uk] INFO: Saving data for 127955: {'created_time': 1773345718.517122, 'last_price_update_time': 1773345718.517131}
2026-03-12 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127914)
2026-03-12 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b4090>
2026-03-12 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:01:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:01:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/7.jpeg saved to cache
2026-03-12 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0524e448-6aa6-5c6b-8abe-9d7074723169
2026-03-12 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127914)
2026-03-12 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67632d50>
2026-03-12 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/6.jpeg saved to cache
2026-03-12 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0524e448-6aa6-5c6b-8abe-9d7074723169
2026-03-12 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127914)
2026-03-12 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67122a90>
2026-03-12 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/5.jpeg saved to cache
2026-03-12 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0524e448-6aa6-5c6b-8abe-9d7074723169
2026-03-12 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127914)
2026-03-12 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b4590>
2026-03-12 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/4.jpeg saved to cache
2026-03-12 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0524e448-6aa6-5c6b-8abe-9d7074723169
2026-03-12 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127914)
2026-03-12 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67122a90>
2026-03-12 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/3.jpeg saved to cache
2026-03-12 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0524e448-6aa6-5c6b-8abe-9d7074723169
2026-03-12 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127914)
2026-03-12 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a3890>
2026-03-12 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/2.jpeg saved to cache
2026-03-12 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0524e448-6aa6-5c6b-8abe-9d7074723169
2026-03-12 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127914)
2026-03-12 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67680610>
2026-03-12 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/1.jpeg saved to cache
2026-03-12 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0524e448-6aa6-5c6b-8abe-9d7074723169
2026-03-12 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127914)
2026-03-12 20:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762a010>
2026-03-12 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/0.jpeg saved to cache
2026-03-12 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0524e448-6aa6-5c6b-8abe-9d7074723169
2026-03-12 20:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0524e448-6aa6-5c6b-8abe-9d7074723169, skipping ID generation
2026-03-12 20:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0524e448-6aa6-5c6b-8abe-9d7074723169 with scrape type 1
2026-03-12 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0524e448-6aa6-5c6b-8abe-9d7074723169 sending to next pipeline
2026-03-12 20:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 0524e448-6aa6-5c6b-8abe-9d7074723169, identifier: 127914
2026-03-12 20:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 0524e448-6aa6-5c6b-8abe-9d7074723169 with identifier: 127914
2026-03-12 20:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 0524e448-6aa6-5c6b-8abe-9d7074723169 with identifier: 127914
2026-03-12 20:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 0524e448-6aa6-5c6b-8abe-9d7074723169 with identifier: 127914 to the API
2026-03-12 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:02:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 226,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': '0524e448-6aa6-5c6b-8abe-9d7074723169',
'is_damaged': False,
'is_operable': True,
'license_plate': 'MM72RWY',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/kia-sportage-estate-2021-16t-gdi-hev-4-5dr-auto-127914',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Kia',
'model': 'SPORTAGE ESTATE (2021)',
'odometer': 28964,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77065,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71467,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81335,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100508,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73340,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64220,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80549,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104264,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73166,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0524e448-6aa6-5c6b-8abe-9d7074723169/0524e448-6aa6-5c6b-8abe-9d7074723169_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91944,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127914/9.jpeg',
'Width': 800}],
'price': 24000.0,
'price_includes_vat': True,
'registration_date': '2022-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'Kia SPORTAGE ESTATE (2021) 1.6T GDi HEV 4 5dr Auto',
'transmission': 'automatic',
'trim': '1.6T GDi HEV 4 5dr Auto',
'vin': 'U5YPV81GMPL059603',
'year': 2022}
2026-03-12 20:02:08 [arval.uk] INFO: Saving data for 127914: {'created_time': 1773345728.026299, 'last_price_update_time': 1773345728.026309}
2026-03-12 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127511)
2026-03-12 20:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16f610>
2026-03-12 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/7.jpeg saved to cache
2026-03-12 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3263eb3-4a1e-512d-8c33-7dd31039698e
2026-03-12 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126268> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8341f88-5995-517b-a5bf-a3aed2e5df04 with identifier: 126268
2026-03-12 20:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8341f88-5995-517b-a5bf-a3aed2e5df04 with scrape type 1
2026-03-12 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8341f88-5995-517b-a5bf-a3aed2e5df04
2026-03-12 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/0.jpeg not downloaded yet
2026-03-12 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/1.jpeg not downloaded yet
2026-03-12 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/2.jpeg not downloaded yet
2026-03-12 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/3.jpeg not downloaded yet
2026-03-12 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/4.jpeg not downloaded yet
2026-03-12 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/5.jpeg not downloaded yet
2026-03-12 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/6.jpeg not downloaded yet
2026-03-12 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/7.jpeg not downloaded yet
2026-03-12 20:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/8.jpeg not downloaded yet
2026-03-12 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/9.jpeg not downloaded yet
2026-03-12 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127511)
2026-03-12 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f7a8a4550>
2026-03-12 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/6.jpeg saved to cache
2026-03-12 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3263eb3-4a1e-512d-8c33-7dd31039698e
2026-03-12 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121355> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa70d477-5a7d-587d-8565-fadd41a2d468 with identifier: 121355
2026-03-12 20:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa70d477-5a7d-587d-8565-fadd41a2d468 with scrape type 1
2026-03-12 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa70d477-5a7d-587d-8565-fadd41a2d468
2026-03-12 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/0.jpeg not downloaded yet
2026-03-12 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/1.jpeg not downloaded yet
2026-03-12 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/2.jpeg not downloaded yet
2026-03-12 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/3.jpeg not downloaded yet
2026-03-12 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/4.jpeg not downloaded yet
2026-03-12 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/5.jpeg not downloaded yet
2026-03-12 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/6.jpeg not downloaded yet
2026-03-12 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/7.jpeg not downloaded yet
2026-03-12 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/8.jpeg not downloaded yet
2026-03-12 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/9.jpeg not downloaded yet
2026-03-12 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124962> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f74cf581-de74-57d9-af8b-b4bc381ba987 with identifier: 124962
2026-03-12 20:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f74cf581-de74-57d9-af8b-b4bc381ba987 with scrape type 1
2026-03-12 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f74cf581-de74-57d9-af8b-b4bc381ba987
2026-03-12 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/0.jpeg not downloaded yet
2026-03-12 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/1.jpeg not downloaded yet
2026-03-12 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/2.jpeg not downloaded yet
2026-03-12 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/3.jpeg not downloaded yet
2026-03-12 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/4.jpeg not downloaded yet
2026-03-12 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127511)
2026-03-12 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/5.jpeg not downloaded yet
2026-03-12 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/6.jpeg not downloaded yet
2026-03-12 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/7.jpeg not downloaded yet
2026-03-12 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/8.jpeg not downloaded yet
2026-03-12 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/9.jpeg not downloaded yet
2026-03-12 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67764b50>
2026-03-12 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/5.jpeg saved to cache
2026-03-12 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3263eb3-4a1e-512d-8c33-7dd31039698e
2026-03-12 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127511)
2026-03-12 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606bc10>
2026-03-12 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/4.jpeg saved to cache
2026-03-12 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3263eb3-4a1e-512d-8c33-7dd31039698e
2026-03-12 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127511)
2026-03-12 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2e9790>
2026-03-12 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/3.jpeg saved to cache
2026-03-12 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3263eb3-4a1e-512d-8c33-7dd31039698e
2026-03-12 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127511)
2026-03-12 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18f5d0>
2026-03-12 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/2.jpeg saved to cache
2026-03-12 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3263eb3-4a1e-512d-8c33-7dd31039698e
2026-03-12 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127511)
2026-03-12 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718f6d0>
2026-03-12 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/1.jpeg saved to cache
2026-03-12 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3263eb3-4a1e-512d-8c33-7dd31039698e
2026-03-12 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127511)
2026-03-12 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67764c90>
2026-03-12 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/0.jpeg saved to cache
2026-03-12 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3263eb3-4a1e-512d-8c33-7dd31039698e
2026-03-12 20:02:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3263eb3-4a1e-512d-8c33-7dd31039698e, skipping ID generation
2026-03-12 20:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3263eb3-4a1e-512d-8c33-7dd31039698e with scrape type 1
2026-03-12 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3263eb3-4a1e-512d-8c33-7dd31039698e sending to next pipeline
2026-03-12 20:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: f3263eb3-4a1e-512d-8c33-7dd31039698e, identifier: 127511
2026-03-12 20:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: f3263eb3-4a1e-512d-8c33-7dd31039698e with identifier: 127511
2026-03-12 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: f3263eb3-4a1e-512d-8c33-7dd31039698e with identifier: 127511
2026-03-12 20:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: f3263eb3-4a1e-512d-8c33-7dd31039698e with identifier: 127511 to the API
2026-03-12 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:02:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 227,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': 'f3263eb3-4a1e-512d-8c33-7dd31039698e',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DV23NTL',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-tucson-estate-2020-16-tgdi-hybrid-230-ultimate-5dr-2wd-auto-127511',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Hyundai',
'model': 'TUCSON ESTATE (2020)',
'odometer': 23176,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43503,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36927,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48031,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46005,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44260,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32925,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44351,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46370,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44500,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3263eb3-4a1e-512d-8c33-7dd31039698e/f3263eb3-4a1e-512d-8c33-7dd31039698e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70180,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127511/9.jpeg',
'Width': 800}],
'price': 24500.0,
'price_includes_vat': True,
'registration_date': '2023-04-11',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai TUCSON ESTATE (2020) 1.6 TGDi Hybrid 230 Ultimate 5dr 2WD '
'Auto',
'transmission': 'automatic',
'trim': '1.6 TGDi Hybrid 230 Ultimate 5dr 2WD Auto',
'vin': 'TMAJE811MPJ167305',
'year': 2023}
2026-03-12 20:02:18 [arval.uk] INFO: Saving data for 127511: {'created_time': 1773345738.283932, 'last_price_update_time': 1773345738.283943}
2026-03-12 20:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128927)
2026-03-12 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6d4eb990>
2026-03-12 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/7.jpeg saved to cache
2026-03-12 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 226403f3-1b7e-547f-a87a-e210532579d6
2026-03-12 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128927)
2026-03-12 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66064f50>
2026-03-12 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/6.jpeg saved to cache
2026-03-12 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 226403f3-1b7e-547f-a87a-e210532579d6
2026-03-12 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128927)
2026-03-12 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762b550>
2026-03-12 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/5.jpeg saved to cache
2026-03-12 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 226403f3-1b7e-547f-a87a-e210532579d6
2026-03-12 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128927)
2026-03-12 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713c910>
2026-03-12 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/4.jpeg saved to cache
2026-03-12 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 226403f3-1b7e-547f-a87a-e210532579d6
2026-03-12 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128927)
2026-03-12 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66025810>
2026-03-12 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/3.jpeg saved to cache
2026-03-12 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 226403f3-1b7e-547f-a87a-e210532579d6
2026-03-12 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128927)
2026-03-12 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713fa50>
2026-03-12 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/2.jpeg saved to cache
2026-03-12 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 226403f3-1b7e-547f-a87a-e210532579d6
2026-03-12 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128927)
2026-03-12 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb73d0>
2026-03-12 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/1.jpeg saved to cache
2026-03-12 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 226403f3-1b7e-547f-a87a-e210532579d6
2026-03-12 20:02:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 226403f3-1b7e-547f-a87a-e210532579d6, skipping ID generation
2026-03-12 20:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 226403f3-1b7e-547f-a87a-e210532579d6 with scrape type 1
2026-03-12 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 226403f3-1b7e-547f-a87a-e210532579d6 sending to next pipeline
2026-03-12 20:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 226403f3-1b7e-547f-a87a-e210532579d6, identifier: 128927
2026-03-12 20:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 226403f3-1b7e-547f-a87a-e210532579d6 with identifier: 128927
2026-03-12 20:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 226403f3-1b7e-547f-a87a-e210532579d6 with identifier: 128927
2026-03-12 20:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 226403f3-1b7e-547f-a87a-e210532579d6 with identifier: 128927 to the API
2026-03-12 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:02:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/1.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'engine_horse_power': 160,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '226403f3-1b7e-547f-a87a-e210532579d6',
'is_damaged': False,
'is_operable': True,
'license_plate': 'WG71VPT',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/mercedes-a-class-hatchback-special-editions-2020-a200-amg-line-executive-edition-5dr-auto-128927',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Mercedes',
'model': 'A CLASS HATCHBACK SPECIAL EDITIONS (2020)',
'odometer': 28847,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90924,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73421,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100807,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116854,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106671,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85609,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98547,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107496,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96583,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_226403f3-1b7e-547f-a87a-e210532579d6/226403f3-1b7e-547f-a87a-e210532579d6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68892,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128927/9.jpeg',
'Width': 800}],
'price': 20100.0,
'price_includes_vat': True,
'registration_date': '2022-01-16',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes A CLASS HATCHBACK SPECIAL EDITIONS (2020) A200 AMG Line '
'Executive Edition 5dr Auto',
'transmission': 'automatic',
'trim': 'A200 AMG Line Executive Edition 5dr Auto',
'vin': 'W1K1770872N271870',
'year': 2022}
2026-03-12 20:02:25 [arval.uk] INFO: Saving data for 128927: {'created_time': 1773345745.498082, 'last_price_update_time': 1773345745.498091}
2026-03-12 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126268)
2026-03-12 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677b9d90>
2026-03-12 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/9.jpeg saved to cache
2026-03-12 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8341f88-5995-517b-a5bf-a3aed2e5df04
2026-03-12 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126268)
2026-03-12 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2e88d0>
2026-03-12 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/8.jpeg saved to cache
2026-03-12 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8341f88-5995-517b-a5bf-a3aed2e5df04
2026-03-12 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121355)
2026-03-12 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f36b10>
2026-03-12 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/9.jpeg saved to cache
2026-03-12 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa70d477-5a7d-587d-8565-fadd41a2d468
2026-03-12 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124962)
2026-03-12 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f8150>
2026-03-12 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/4.jpeg saved to cache
2026-03-12 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f74cf581-de74-57d9-af8b-b4bc381ba987
2026-03-12 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124962)
2026-03-12 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c1784d0>
2026-03-12 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/9.jpeg saved to cache
2026-03-12 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f74cf581-de74-57d9-af8b-b4bc381ba987
2026-03-12 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124962)
2026-03-12 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660510d0>
2026-03-12 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/8.jpeg saved to cache
2026-03-12 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f74cf581-de74-57d9-af8b-b4bc381ba987
2026-03-12 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124962)
2026-03-12 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2e9ed0>
2026-03-12 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/7.jpeg saved to cache
2026-03-12 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f74cf581-de74-57d9-af8b-b4bc381ba987
2026-03-12 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124962)
2026-03-12 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660680d0>
2026-03-12 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/6.jpeg saved to cache
2026-03-12 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f74cf581-de74-57d9-af8b-b4bc381ba987
2026-03-12 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124962)
2026-03-12 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f78c90>
2026-03-12 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/5.jpeg saved to cache
2026-03-12 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f74cf581-de74-57d9-af8b-b4bc381ba987
2026-03-12 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124962)
2026-03-12 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712acd0>
2026-03-12 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/3.jpeg saved to cache
2026-03-12 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f74cf581-de74-57d9-af8b-b4bc381ba987
2026-03-12 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124962)
2026-03-12 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2e8710>
2026-03-12 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/2.jpeg saved to cache
2026-03-12 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f74cf581-de74-57d9-af8b-b4bc381ba987
2026-03-12 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124962)
2026-03-12 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b6350>
2026-03-12 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/1.jpeg saved to cache
2026-03-12 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f74cf581-de74-57d9-af8b-b4bc381ba987
2026-03-12 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124962)
2026-03-12 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66066490>
2026-03-12 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/0.jpeg saved to cache
2026-03-12 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f74cf581-de74-57d9-af8b-b4bc381ba987
2026-03-12 20:02:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f74cf581-de74-57d9-af8b-b4bc381ba987, skipping ID generation
2026-03-12 20:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f74cf581-de74-57d9-af8b-b4bc381ba987 with scrape type 1
2026-03-12 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f74cf581-de74-57d9-af8b-b4bc381ba987 sending to next pipeline
2026-03-12 20:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: f74cf581-de74-57d9-af8b-b4bc381ba987, identifier: 124962
2026-03-12 20:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: f74cf581-de74-57d9-af8b-b4bc381ba987 with identifier: 124962
2026-03-12 20:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: f74cf581-de74-57d9-af8b-b4bc381ba987 with identifier: 124962
2026-03-12 20:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: f74cf581-de74-57d9-af8b-b4bc381ba987 with identifier: 124962 to the API
2026-03-12 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:02:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 227,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': 'f74cf581-de74-57d9-af8b-b4bc381ba987',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DU23YSZ',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-tucson-estate-2020-16-tgdi-hybrid-230-ultimate-5dr-2wd-auto-124962',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Hyundai',
'model': 'TUCSON ESTATE (2020)',
'odometer': 20786,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40660,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42306,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40882,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36961,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41370,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41720,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42458,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38757,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96477,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74cf581-de74-57d9-af8b-b4bc381ba987/f74cf581-de74-57d9-af8b-b4bc381ba987_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59289,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124962/9.jpeg',
'Width': 800}],
'price': 23300.0,
'price_includes_vat': True,
'registration_date': '2023-03-06',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai TUCSON ESTATE (2020) 1.6 TGDi Hybrid 230 Ultimate 5dr 2WD '
'Auto',
'transmission': 'automatic',
'trim': '1.6 TGDi Hybrid 230 Ultimate 5dr 2WD Auto',
'vin': 'TMAJE811MPJ156224',
'year': 2023}
2026-03-12 20:02:41 [arval.uk] INFO: Saving data for 124962: {'created_time': 1773345761.167076, 'last_price_update_time': 1773345761.167087}
2026-03-12 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121355)
2026-03-12 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67604850>
2026-03-12 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/8.jpeg saved to cache
2026-03-12 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa70d477-5a7d-587d-8565-fadd41a2d468
2026-03-12 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121355)
2026-03-12 20:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6dc72790>
2026-03-12 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/7.jpeg saved to cache
2026-03-12 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa70d477-5a7d-587d-8565-fadd41a2d468
2026-03-12 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121355)
2026-03-12 20:02:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677668d0>
2026-03-12 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/6.jpeg saved to cache
2026-03-12 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa70d477-5a7d-587d-8565-fadd41a2d468
2026-03-12 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124952> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7506ff89-322a-57a5-9733-0eb1c14a733f with identifier: 124952
2026-03-12 20:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7506ff89-322a-57a5-9733-0eb1c14a733f with scrape type 1
2026-03-12 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7506ff89-322a-57a5-9733-0eb1c14a733f
2026-03-12 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/0.jpeg not downloaded yet
2026-03-12 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/1.jpeg not downloaded yet
2026-03-12 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/2.jpeg not downloaded yet
2026-03-12 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/3.jpeg not downloaded yet
2026-03-12 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/4.jpeg not downloaded yet
2026-03-12 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/5.jpeg not downloaded yet
2026-03-12 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/6.jpeg not downloaded yet
2026-03-12 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/7.jpeg not downloaded yet
2026-03-12 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/8.jpeg not downloaded yet
2026-03-12 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/9.jpeg not downloaded yet
2026-03-12 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121355)
2026-03-12 20:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18fe90>
2026-03-12 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/5.jpeg saved to cache
2026-03-12 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa70d477-5a7d-587d-8565-fadd41a2d468
2026-03-12 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128930> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ed0fd72-de49-5649-861d-b9d5724ee0be with identifier: 128930
2026-03-12 20:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ed0fd72-de49-5649-861d-b9d5724ee0be with scrape type 1
2026-03-12 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ed0fd72-de49-5649-861d-b9d5724ee0be
2026-03-12 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/0.jpeg not downloaded yet
2026-03-12 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/1.jpeg not downloaded yet
2026-03-12 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/2.jpeg not downloaded yet
2026-03-12 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/3.jpeg not downloaded yet
2026-03-12 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/4.jpeg not downloaded yet
2026-03-12 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/5.jpeg not downloaded yet
2026-03-12 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/6.jpeg not downloaded yet
2026-03-12 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/7.jpeg not downloaded yet
2026-03-12 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/8.jpeg not downloaded yet
2026-03-12 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/9.jpeg not downloaded yet
2026-03-12 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121355)
2026-03-12 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766fc10>
2026-03-12 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/4.jpeg saved to cache
2026-03-12 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa70d477-5a7d-587d-8565-fadd41a2d468
2026-03-12 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127328> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2bac289-7042-50b3-a813-26eacca61dad with identifier: 127328
2026-03-12 20:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2bac289-7042-50b3-a813-26eacca61dad with scrape type 1
2026-03-12 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2bac289-7042-50b3-a813-26eacca61dad
2026-03-12 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/0.jpeg not downloaded yet
2026-03-12 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/1.jpeg not downloaded yet
2026-03-12 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/2.jpeg not downloaded yet
2026-03-12 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/3.jpeg not downloaded yet
2026-03-12 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/4.jpeg not downloaded yet
2026-03-12 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/5.jpeg not downloaded yet
2026-03-12 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/6.jpeg not downloaded yet
2026-03-12 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/7.jpeg not downloaded yet
2026-03-12 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/8.jpeg not downloaded yet
2026-03-12 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/9.jpeg not downloaded yet
2026-03-12 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121355)
2026-03-12 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f370d0>
2026-03-12 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/3.jpeg saved to cache
2026-03-12 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa70d477-5a7d-587d-8565-fadd41a2d468
2026-03-12 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121355)
2026-03-12 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66027790>
2026-03-12 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/2.jpeg saved to cache
2026-03-12 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa70d477-5a7d-587d-8565-fadd41a2d468
2026-03-12 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121355)
2026-03-12 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cfa51d0>
2026-03-12 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/1.jpeg saved to cache
2026-03-12 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa70d477-5a7d-587d-8565-fadd41a2d468
2026-03-12 20:02:51 [scrapy.extensions.logstats] INFO: Crawled 67 pages (at 6 pages/min), scraped 33 items (at 5 items/min)
2026-03-12 20:02:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121355)
2026-03-12 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713d490>
2026-03-12 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/0.jpeg saved to cache
2026-03-12 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa70d477-5a7d-587d-8565-fadd41a2d468
2026-03-12 20:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa70d477-5a7d-587d-8565-fadd41a2d468, skipping ID generation
2026-03-12 20:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa70d477-5a7d-587d-8565-fadd41a2d468 with scrape type 1
2026-03-12 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa70d477-5a7d-587d-8565-fadd41a2d468 sending to next pipeline
2026-03-12 20:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: fa70d477-5a7d-587d-8565-fadd41a2d468, identifier: 121355
2026-03-12 20:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: fa70d477-5a7d-587d-8565-fadd41a2d468 with identifier: 121355
2026-03-12 20:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: fa70d477-5a7d-587d-8565-fadd41a2d468 with identifier: 121355
2026-03-12 20:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: fa70d477-5a7d-587d-8565-fadd41a2d468 with identifier: 121355 to the API
2026-03-12 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:02:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 226,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': 'fa70d477-5a7d-587d-8565-fadd41a2d468',
'is_damaged': False,
'is_operable': True,
'license_plate': 'FL72LRF',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/kia-sportage-estate-2021-16t-gdi-hev-4-5dr-auto-121355',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Kia',
'model': 'SPORTAGE ESTATE (2021)',
'odometer': 20017,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68425,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65102,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64969,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54197,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55683,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144200,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81202,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111766,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116834,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa70d477-5a7d-587d-8565-fadd41a2d468/fa70d477-5a7d-587d-8565-fadd41a2d468_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97785,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121355/9.jpeg',
'Width': 1280}],
'price': 23500.0,
'price_includes_vat': True,
'registration_date': '2022-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Kia SPORTAGE ESTATE (2021) 1.6T GDi HEV 4 5dr Auto',
'transmission': 'automatic',
'trim': '1.6T GDi HEV 4 5dr Auto',
'vin': 'U5YPV81GMNL043149',
'year': 2022}
2026-03-12 20:02:52 [arval.uk] INFO: Saving data for 121355: {'created_time': 1773345772.535559, 'last_price_update_time': 1773345772.535569}
2026-03-12 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126268)
2026-03-12 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606b610>
2026-03-12 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/7.jpeg saved to cache
2026-03-12 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8341f88-5995-517b-a5bf-a3aed2e5df04
2026-03-12 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126268)
2026-03-12 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762b750>
2026-03-12 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/6.jpeg saved to cache
2026-03-12 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8341f88-5995-517b-a5bf-a3aed2e5df04
2026-03-12 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126268)
2026-03-12 20:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67647490>
2026-03-12 20:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/5.jpeg saved to cache
2026-03-12 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8341f88-5995-517b-a5bf-a3aed2e5df04
2026-03-12 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126268)
2026-03-12 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c116cd0>
2026-03-12 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/4.jpeg saved to cache
2026-03-12 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8341f88-5995-517b-a5bf-a3aed2e5df04
2026-03-12 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126268)
2026-03-12 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67606f10>
2026-03-12 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/3.jpeg saved to cache
2026-03-12 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8341f88-5995-517b-a5bf-a3aed2e5df04
2026-03-12 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126268)
2026-03-12 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762a350>
2026-03-12 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/2.jpeg saved to cache
2026-03-12 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8341f88-5995-517b-a5bf-a3aed2e5df04
2026-03-12 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126268)
2026-03-12 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660264d0>
2026-03-12 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/1.jpeg saved to cache
2026-03-12 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8341f88-5995-517b-a5bf-a3aed2e5df04
2026-03-12 20:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126268)
2026-03-12 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606b7d0>
2026-03-12 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/0.jpeg saved to cache
2026-03-12 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8341f88-5995-517b-a5bf-a3aed2e5df04
2026-03-12 20:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8341f88-5995-517b-a5bf-a3aed2e5df04, skipping ID generation
2026-03-12 20:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8341f88-5995-517b-a5bf-a3aed2e5df04 with scrape type 1
2026-03-12 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8341f88-5995-517b-a5bf-a3aed2e5df04 sending to next pipeline
2026-03-12 20:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: b8341f88-5995-517b-a5bf-a3aed2e5df04, identifier: 126268
2026-03-12 20:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: b8341f88-5995-517b-a5bf-a3aed2e5df04 with identifier: 126268
2026-03-12 20:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: b8341f88-5995-517b-a5bf-a3aed2e5df04 with identifier: 126268
2026-03-12 20:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: b8341f88-5995-517b-a5bf-a3aed2e5df04 with identifier: 126268 to the API
2026-03-12 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:03:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 226,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': 'b8341f88-5995-517b-a5bf-a3aed2e5df04',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YH72MWC',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/kia-sportage-estate-2021-16t-gdi-hev-gt-line-s-5dr-auto-126268',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Kia',
'model': 'SPORTAGE ESTATE (2021)',
'odometer': 31519,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78854,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65615,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80339,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91466,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75516,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64133,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74801,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88276,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64353,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8341f88-5995-517b-a5bf-a3aed2e5df04/b8341f88-5995-517b-a5bf-a3aed2e5df04_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96010,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126268/9.jpeg',
'Width': 800}],
'price': 23500.0,
'price_includes_vat': True,
'registration_date': '2022-12-12',
'seats_number': 5,
'seller_name': None,
'title': 'Kia SPORTAGE ESTATE (2021) 1.6T GDi HEV GT-Line S 5dr Auto',
'transmission': 'automatic',
'trim': '1.6T GDi HEV GT-Line S 5dr Auto',
'vin': 'U5YPX81GMPL057120',
'year': 2022}
2026-03-12 20:03:01 [arval.uk] INFO: Saving data for 126268: {'created_time': 1773345781.91163, 'last_price_update_time': 1773345781.911639}
2026-03-12 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124952)
2026-03-12 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67765290>
2026-03-12 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/9.jpeg saved to cache
2026-03-12 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7506ff89-322a-57a5-9733-0eb1c14a733f
2026-03-12 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124952)
2026-03-12 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606bb90>
2026-03-12 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/8.jpeg saved to cache
2026-03-12 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7506ff89-322a-57a5-9733-0eb1c14a733f
2026-03-12 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128930)
2026-03-12 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67144e90>
2026-03-12 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/9.jpeg saved to cache
2026-03-12 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ed0fd72-de49-5649-861d-b9d5724ee0be
2026-03-12 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128930)
2026-03-12 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713a110>
2026-03-12 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/8.jpeg saved to cache
2026-03-12 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ed0fd72-de49-5649-861d-b9d5724ee0be
2026-03-12 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127328)
2026-03-12 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1d350>
2026-03-12 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/9.jpeg saved to cache
2026-03-12 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2bac289-7042-50b3-a813-26eacca61dad
2026-03-12 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127328)
2026-03-12 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1f810>
2026-03-12 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/8.jpeg saved to cache
2026-03-12 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2bac289-7042-50b3-a813-26eacca61dad
2026-03-12 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127328)
2026-03-12 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66064810>
2026-03-12 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/7.jpeg saved to cache
2026-03-12 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2bac289-7042-50b3-a813-26eacca61dad
2026-03-12 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127328)
2026-03-12 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18d5d0>
2026-03-12 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/6.jpeg saved to cache
2026-03-12 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2bac289-7042-50b3-a813-26eacca61dad
2026-03-12 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127328)
2026-03-12 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb7a90>
2026-03-12 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/5.jpeg saved to cache
2026-03-12 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2bac289-7042-50b3-a813-26eacca61dad
2026-03-12 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127328)
2026-03-12 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766d7d0>
2026-03-12 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/4.jpeg saved to cache
2026-03-12 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2bac289-7042-50b3-a813-26eacca61dad
2026-03-12 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127328)
2026-03-12 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67750050>
2026-03-12 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/3.jpeg saved to cache
2026-03-12 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2bac289-7042-50b3-a813-26eacca61dad
2026-03-12 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127328)
2026-03-12 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677b9d90>
2026-03-12 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/2.jpeg saved to cache
2026-03-12 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2bac289-7042-50b3-a813-26eacca61dad
2026-03-12 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127328)
2026-03-12 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f36950>
2026-03-12 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/1.jpeg saved to cache
2026-03-12 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2bac289-7042-50b3-a813-26eacca61dad
2026-03-12 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127328)
2026-03-12 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7bd50>
2026-03-12 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/0.jpeg saved to cache
2026-03-12 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2bac289-7042-50b3-a813-26eacca61dad
2026-03-12 20:03:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2bac289-7042-50b3-a813-26eacca61dad, skipping ID generation
2026-03-12 20:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2bac289-7042-50b3-a813-26eacca61dad with scrape type 1
2026-03-12 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2bac289-7042-50b3-a813-26eacca61dad sending to next pipeline
2026-03-12 20:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: c2bac289-7042-50b3-a813-26eacca61dad, identifier: 127328
2026-03-12 20:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: c2bac289-7042-50b3-a813-26eacca61dad with identifier: 127328
2026-03-12 20:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: c2bac289-7042-50b3-a813-26eacca61dad with identifier: 127328
2026-03-12 20:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: c2bac289-7042-50b3-a813-26eacca61dad with identifier: 127328 to the API
2026-03-12 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:03:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 226,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': 'c2bac289-7042-50b3-a813-26eacca61dad',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BF23DMO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/kia-sportage-estate-2021-16t-gdi-hev-3-5dr-auto-127328',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Kia',
'model': 'SPORTAGE ESTATE (2021)',
'odometer': 34506,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98586,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79770,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95346,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110357,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109333,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84846,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84618,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99312,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93505,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2bac289-7042-50b3-a813-26eacca61dad/c2bac289-7042-50b3-a813-26eacca61dad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74498,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127328/9.jpeg',
'Width': 800}],
'price': 22800.0,
'price_includes_vat': True,
'registration_date': '2023-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Kia SPORTAGE ESTATE (2021) 1.6T GDi HEV 3 5dr Auto',
'transmission': 'automatic',
'trim': '1.6T GDi HEV 3 5dr Auto',
'vin': 'U5YPV81GMPL066336',
'year': 2023}
2026-03-12 20:03:18 [arval.uk] INFO: Saving data for 127328: {'created_time': 1773345798.842757, 'last_price_update_time': 1773345798.842767}
2026-03-12 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128930)
2026-03-12 20:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762a5d0>
2026-03-12 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/7.jpeg saved to cache
2026-03-12 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ed0fd72-de49-5649-861d-b9d5724ee0be
2026-03-12 20:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128930)
2026-03-12 20:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124960> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbde3d0>
2026-03-12 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/6.jpeg saved to cache
2026-03-12 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ed0fd72-de49-5649-861d-b9d5724ee0be
2026-03-12 20:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8d88d7d-9239-58ee-afc3-0a6bf5f27846 with identifier: 124960
2026-03-12 20:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846 with scrape type 1
2026-03-12 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846
2026-03-12 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/0.jpeg not downloaded yet
2026-03-12 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/1.jpeg not downloaded yet
2026-03-12 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/2.jpeg not downloaded yet
2026-03-12 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/3.jpeg not downloaded yet
2026-03-12 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/4.jpeg not downloaded yet
2026-03-12 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/5.jpeg not downloaded yet
2026-03-12 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/6.jpeg not downloaded yet
2026-03-12 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/7.jpeg not downloaded yet
2026-03-12 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/8.jpeg not downloaded yet
2026-03-12 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/9.jpeg not downloaded yet
2026-03-12 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128930)
2026-03-12 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762b490>
2026-03-12 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/5.jpeg saved to cache
2026-03-12 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ed0fd72-de49-5649-861d-b9d5724ee0be
2026-03-12 20:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124008> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4889488-b2c7-56a3-864c-57e24987a0ca with identifier: 124008
2026-03-12 20:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4889488-b2c7-56a3-864c-57e24987a0ca with scrape type 1
2026-03-12 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4889488-b2c7-56a3-864c-57e24987a0ca
2026-03-12 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/0.jpeg not downloaded yet
2026-03-12 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/1.jpeg not downloaded yet
2026-03-12 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/2.jpeg not downloaded yet
2026-03-12 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/3.jpeg not downloaded yet
2026-03-12 20:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128930)
2026-03-12 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/4.jpeg not downloaded yet
2026-03-12 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/5.jpeg not downloaded yet
2026-03-12 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/6.jpeg not downloaded yet
2026-03-12 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/7.jpeg not downloaded yet
2026-03-12 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/8.jpeg not downloaded yet
2026-03-12 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/9.jpeg not downloaded yet
2026-03-12 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67145bd0>
2026-03-12 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/4.jpeg saved to cache
2026-03-12 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ed0fd72-de49-5649-861d-b9d5724ee0be
2026-03-12 20:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120780> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33d58697-f164-5c68-b3f5-532e85c25b99 with identifier: 120780
2026-03-12 20:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33d58697-f164-5c68-b3f5-532e85c25b99 with scrape type 1
2026-03-12 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33d58697-f164-5c68-b3f5-532e85c25b99
2026-03-12 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/0.jpeg not downloaded yet
2026-03-12 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/1.jpeg not downloaded yet
2026-03-12 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/2.jpeg not downloaded yet
2026-03-12 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/3.jpeg not downloaded yet
2026-03-12 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/4.jpeg not downloaded yet
2026-03-12 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/5.jpeg not downloaded yet
2026-03-12 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/6.jpeg not downloaded yet
2026-03-12 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/7.jpeg not downloaded yet
2026-03-12 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/8.jpeg not downloaded yet
2026-03-12 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/9.jpeg not downloaded yet
2026-03-12 20:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128930)
2026-03-12 20:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c178d10>
2026-03-12 20:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/3.jpeg saved to cache
2026-03-12 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ed0fd72-de49-5649-861d-b9d5724ee0be
2026-03-12 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128930)
2026-03-12 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66050390>
2026-03-12 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/2.jpeg saved to cache
2026-03-12 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ed0fd72-de49-5649-861d-b9d5724ee0be
2026-03-12 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128930)
2026-03-12 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7a750>
2026-03-12 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/1.jpeg saved to cache
2026-03-12 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ed0fd72-de49-5649-861d-b9d5724ee0be
2026-03-12 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128930)
2026-03-12 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66050110>
2026-03-12 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/0.jpeg saved to cache
2026-03-12 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ed0fd72-de49-5649-861d-b9d5724ee0be
2026-03-12 20:03:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ed0fd72-de49-5649-861d-b9d5724ee0be, skipping ID generation
2026-03-12 20:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ed0fd72-de49-5649-861d-b9d5724ee0be with scrape type 1
2026-03-12 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ed0fd72-de49-5649-861d-b9d5724ee0be sending to next pipeline
2026-03-12 20:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 3ed0fd72-de49-5649-861d-b9d5724ee0be, identifier: 128930
2026-03-12 20:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 3ed0fd72-de49-5649-861d-b9d5724ee0be with identifier: 128930
2026-03-12 20:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 3ed0fd72-de49-5649-861d-b9d5724ee0be with identifier: 128930
2026-03-12 20:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 3ed0fd72-de49-5649-861d-b9d5724ee0be with identifier: 128930 to the API
2026-03-12 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:03:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '3ed0fd72-de49-5649-861d-b9d5724ee0be',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YH74RJX',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/cupra-ateca-estate-2020-15-ecotsi-v1-5dr-dsg-128930',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Cupra',
'model': 'ATECA ESTATE (2020)',
'odometer': 11919,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94744,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79132,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84371,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102215,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94947,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79788,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92641,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105193,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104527,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed0fd72-de49-5649-861d-b9d5724ee0be/3ed0fd72-de49-5649-861d-b9d5724ee0be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73998,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128930/9.jpeg',
'Width': 800}],
'price': 23100.0,
'price_includes_vat': True,
'registration_date': '2024-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Cupra ATECA ESTATE (2020) 1.5 EcoTSI V1 5dr DSG',
'transmission': 'automatic',
'trim': '1.5 EcoTSI V1 5dr DSG',
'vin': 'VSSZZZ5F7S6502081',
'year': 2024}
2026-03-12 20:03:29 [arval.uk] INFO: Saving data for 128930: {'created_time': 1773345809.554809, 'last_price_update_time': 1773345809.554818}
2026-03-12 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124952)
2026-03-12 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713cd90>
2026-03-12 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/7.jpeg saved to cache
2026-03-12 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7506ff89-322a-57a5-9733-0eb1c14a733f
2026-03-12 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124952)
2026-03-12 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66082b50>
2026-03-12 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/6.jpeg saved to cache
2026-03-12 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7506ff89-322a-57a5-9733-0eb1c14a733f
2026-03-12 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124952)
2026-03-12 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762a250>
2026-03-12 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/5.jpeg saved to cache
2026-03-12 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7506ff89-322a-57a5-9733-0eb1c14a733f
2026-03-12 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124952)
2026-03-12 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66083510>
2026-03-12 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/4.jpeg saved to cache
2026-03-12 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7506ff89-322a-57a5-9733-0eb1c14a733f
2026-03-12 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124952)
2026-03-12 20:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c12ebd0>
2026-03-12 20:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/3.jpeg saved to cache
2026-03-12 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7506ff89-322a-57a5-9733-0eb1c14a733f
2026-03-12 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124952)
2026-03-12 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b4b90>
2026-03-12 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/2.jpeg saved to cache
2026-03-12 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7506ff89-322a-57a5-9733-0eb1c14a733f
2026-03-12 20:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124952)
2026-03-12 20:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6ced9bd0>
2026-03-12 20:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/1.jpeg saved to cache
2026-03-12 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7506ff89-322a-57a5-9733-0eb1c14a733f
2026-03-12 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124952)
2026-03-12 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66083210>
2026-03-12 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/0.jpeg saved to cache
2026-03-12 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7506ff89-322a-57a5-9733-0eb1c14a733f
2026-03-12 20:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7506ff89-322a-57a5-9733-0eb1c14a733f, skipping ID generation
2026-03-12 20:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7506ff89-322a-57a5-9733-0eb1c14a733f with scrape type 1
2026-03-12 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7506ff89-322a-57a5-9733-0eb1c14a733f sending to next pipeline
2026-03-12 20:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 7506ff89-322a-57a5-9733-0eb1c14a733f, identifier: 124952
2026-03-12 20:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 7506ff89-322a-57a5-9733-0eb1c14a733f with identifier: 124952
2026-03-12 20:03:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 20:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 7506ff89-322a-57a5-9733-0eb1c14a733f with identifier: 124952
2026-03-12 20:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 7506ff89-322a-57a5-9733-0eb1c14a733f with identifier: 124952 to the API
2026-03-12 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:03:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 226,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': '7506ff89-322a-57a5-9733-0eb1c14a733f',
'is_damaged': False,
'is_operable': True,
'license_plate': 'RF72MYD',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/kia-sportage-estate-2021-16t-gdi-hev-gt-line-s-5dr-auto-124952',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Kia',
'model': 'SPORTAGE ESTATE (2021)',
'odometer': 32018,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51593,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43325,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50782,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42868,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48453,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39624,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49299,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44861,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33159,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7506ff89-322a-57a5-9733-0eb1c14a733f/7506ff89-322a-57a5-9733-0eb1c14a733f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54540,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124952/9.jpeg',
'Width': 800}],
'price': 23200.0,
'price_includes_vat': True,
'registration_date': '2023-01-22',
'seats_number': 5,
'seller_name': None,
'title': 'Kia SPORTAGE ESTATE (2021) 1.6T GDi HEV GT-Line S 5dr Auto',
'transmission': 'automatic',
'trim': '1.6T GDi HEV GT-Line S 5dr Auto',
'vin': 'U5YPX81GMPL062467',
'year': 2023}
2026-03-12 20:03:39 [arval.uk] INFO: Saving data for 124952: {'created_time': 1773345819.072936, 'last_price_update_time': 1773345819.072945}
2026-03-12 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124960)
2026-03-12 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766c2d0>
2026-03-12 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/9.jpeg saved to cache
2026-03-12 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846
2026-03-12 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124960)
2026-03-12 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606ad10>
2026-03-12 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/8.jpeg saved to cache
2026-03-12 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846
2026-03-12 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124008)
2026-03-12 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677500d0>
2026-03-12 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/3.jpeg saved to cache
2026-03-12 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4889488-b2c7-56a3-864c-57e24987a0ca
2026-03-12 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124008)
2026-03-12 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f87d0>
2026-03-12 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/9.jpeg saved to cache
2026-03-12 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4889488-b2c7-56a3-864c-57e24987a0ca
2026-03-12 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120780)
2026-03-12 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbde650>
2026-03-12 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/9.jpeg saved to cache
2026-03-12 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33d58697-f164-5c68-b3f5-532e85c25b99
2026-03-12 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120780)
2026-03-12 20:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66067750>
2026-03-12 20:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/8.jpeg saved to cache
2026-03-12 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33d58697-f164-5c68-b3f5-532e85c25b99
2026-03-12 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120780)
2026-03-12 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763b910>
2026-03-12 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/7.jpeg saved to cache
2026-03-12 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33d58697-f164-5c68-b3f5-532e85c25b99
2026-03-12 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120780)
2026-03-12 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66050790>
2026-03-12 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/6.jpeg saved to cache
2026-03-12 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33d58697-f164-5c68-b3f5-532e85c25b99
2026-03-12 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120780)
2026-03-12 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766fa10>
2026-03-12 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/5.jpeg saved to cache
2026-03-12 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33d58697-f164-5c68-b3f5-532e85c25b99
2026-03-12 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120780)
2026-03-12 20:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677040d0>
2026-03-12 20:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/4.jpeg saved to cache
2026-03-12 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33d58697-f164-5c68-b3f5-532e85c25b99
2026-03-12 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120780)
2026-03-12 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67632650>
2026-03-12 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/3.jpeg saved to cache
2026-03-12 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33d58697-f164-5c68-b3f5-532e85c25b99
2026-03-12 20:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120780)
2026-03-12 20:03:51 [scrapy.extensions.logstats] INFO: Crawled 71 pages (at 4 pages/min), scraped 38 items (at 5 items/min)
2026-03-12 20:03:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66027b50>
2026-03-12 20:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/2.jpeg saved to cache
2026-03-12 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33d58697-f164-5c68-b3f5-532e85c25b99
2026-03-12 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120780)
2026-03-12 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67633850>
2026-03-12 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/1.jpeg saved to cache
2026-03-12 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33d58697-f164-5c68-b3f5-532e85c25b99
2026-03-12 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/120780)
2026-03-12 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b7c50>
2026-03-12 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/0.jpeg saved to cache
2026-03-12 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33d58697-f164-5c68-b3f5-532e85c25b99
2026-03-12 20:03:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33d58697-f164-5c68-b3f5-532e85c25b99, skipping ID generation
2026-03-12 20:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33d58697-f164-5c68-b3f5-532e85c25b99 with scrape type 1
2026-03-12 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33d58697-f164-5c68-b3f5-532e85c25b99 sending to next pipeline
2026-03-12 20:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 33d58697-f164-5c68-b3f5-532e85c25b99, identifier: 120780
2026-03-12 20:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 33d58697-f164-5c68-b3f5-532e85c25b99 with identifier: 120780
2026-03-12 20:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 33d58697-f164-5c68-b3f5-532e85c25b99 with identifier: 120780
2026-03-12 20:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 33d58697-f164-5c68-b3f5-532e85c25b99 with identifier: 120780 to the API
2026-03-12 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:03:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 227,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': '33d58697-f164-5c68-b3f5-532e85c25b99',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DS72BRX',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-tucson-estate-2020-16-tgdi-hybrid-230-ultimate-5dr-2wd-auto-120780',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Hyundai',
'model': 'TUCSON ESTATE (2020)',
'odometer': 18451,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 59,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69419,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68488,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48098,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56369,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67964,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58070,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59662,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36598,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46938,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d58697-f164-5c68-b3f5-532e85c25b99/33d58697-f164-5c68-b3f5-532e85c25b99_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66117,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/120780/9.jpeg',
'Width': 800}],
'price': 22600.0,
'price_includes_vat': True,
'registration_date': '2022-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai TUCSON ESTATE (2020) 1.6 TGDi Hybrid 230 Ultimate 5dr 2WD '
'Auto',
'transmission': 'automatic',
'trim': '1.6 TGDi Hybrid 230 Ultimate 5dr 2WD Auto',
'vin': 'TMAJE811MNJ144191',
'year': 2022}
2026-03-12 20:03:55 [arval.uk] INFO: Saving data for 120780: {'created_time': 1773345835.04181, 'last_price_update_time': 1773345835.04182}
2026-03-12 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124008)
2026-03-12 20:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aaed0>
2026-03-12 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/8.jpeg saved to cache
2026-03-12 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4889488-b2c7-56a3-864c-57e24987a0ca
2026-03-12 20:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124008)
2026-03-12 20:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66083e50>
2026-03-12 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/7.jpeg saved to cache
2026-03-12 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4889488-b2c7-56a3-864c-57e24987a0ca
2026-03-12 20:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129580> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfa93ee1-373c-5ea3-ae1c-b3655f02124b with identifier: 129580
2026-03-12 20:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b with scrape type 1
2026-03-12 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b
2026-03-12 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/0.jpeg not downloaded yet
2026-03-12 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/1.jpeg not downloaded yet
2026-03-12 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/2.jpeg not downloaded yet
2026-03-12 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/3.jpeg not downloaded yet
2026-03-12 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/4.jpeg not downloaded yet
2026-03-12 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/5.jpeg not downloaded yet
2026-03-12 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/6.jpeg not downloaded yet
2026-03-12 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/7.jpeg not downloaded yet
2026-03-12 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/8.jpeg not downloaded yet
2026-03-12 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/9.jpeg not downloaded yet
2026-03-12 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124008)
2026-03-12 20:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a88d0>
2026-03-12 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/6.jpeg saved to cache
2026-03-12 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4889488-b2c7-56a3-864c-57e24987a0ca
2026-03-12 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126956> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2437a058-69e5-5db4-8407-47448f7909e1 with identifier: 126956
2026-03-12 20:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2437a058-69e5-5db4-8407-47448f7909e1 with scrape type 1
2026-03-12 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2437a058-69e5-5db4-8407-47448f7909e1
2026-03-12 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/0.jpeg not downloaded yet
2026-03-12 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/1.jpeg not downloaded yet
2026-03-12 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/2.jpeg not downloaded yet
2026-03-12 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/3.jpeg not downloaded yet
2026-03-12 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/4.jpeg not downloaded yet
2026-03-12 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/5.jpeg not downloaded yet
2026-03-12 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/6.jpeg not downloaded yet
2026-03-12 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/7.jpeg not downloaded yet
2026-03-12 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/8.jpeg not downloaded yet
2026-03-12 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/9.jpeg not downloaded yet
2026-03-12 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124008)
2026-03-12 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16ea10>
2026-03-12 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/5.jpeg saved to cache
2026-03-12 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4889488-b2c7-56a3-864c-57e24987a0ca
2026-03-12 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124732> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbe329fd-641d-5af0-a216-fcd511fe6472 with identifier: 124732
2026-03-12 20:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbe329fd-641d-5af0-a216-fcd511fe6472 with scrape type 1
2026-03-12 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbe329fd-641d-5af0-a216-fcd511fe6472
2026-03-12 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/0.jpeg not downloaded yet
2026-03-12 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/1.jpeg not downloaded yet
2026-03-12 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/2.jpeg not downloaded yet
2026-03-12 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/3.jpeg not downloaded yet
2026-03-12 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/4.jpeg not downloaded yet
2026-03-12 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/5.jpeg not downloaded yet
2026-03-12 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/6.jpeg not downloaded yet
2026-03-12 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/7.jpeg not downloaded yet
2026-03-12 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/8.jpeg not downloaded yet
2026-03-12 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/9.jpeg not downloaded yet
2026-03-12 20:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124008)
2026-03-12 20:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713b710>
2026-03-12 20:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/4.jpeg saved to cache
2026-03-12 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4889488-b2c7-56a3-864c-57e24987a0ca
2026-03-12 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124008)
2026-03-12 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66077390>
2026-03-12 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/2.jpeg saved to cache
2026-03-12 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4889488-b2c7-56a3-864c-57e24987a0ca
2026-03-12 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124008)
2026-03-12 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713c550>
2026-03-12 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/1.jpeg saved to cache
2026-03-12 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4889488-b2c7-56a3-864c-57e24987a0ca
2026-03-12 20:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124008)
2026-03-12 20:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b5d90>
2026-03-12 20:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/0.jpeg saved to cache
2026-03-12 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4889488-b2c7-56a3-864c-57e24987a0ca
2026-03-12 20:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4889488-b2c7-56a3-864c-57e24987a0ca, skipping ID generation
2026-03-12 20:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4889488-b2c7-56a3-864c-57e24987a0ca with scrape type 1
2026-03-12 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4889488-b2c7-56a3-864c-57e24987a0ca sending to next pipeline
2026-03-12 20:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: b4889488-b2c7-56a3-864c-57e24987a0ca, identifier: 124008
2026-03-12 20:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: b4889488-b2c7-56a3-864c-57e24987a0ca with identifier: 124008
2026-03-12 20:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: b4889488-b2c7-56a3-864c-57e24987a0ca with identifier: 124008
2026-03-12 20:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: b4889488-b2c7-56a3-864c-57e24987a0ca with identifier: 124008 to the API
2026-03-12 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:04:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 261,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'b4889488-b2c7-56a3-864c-57e24987a0ca',
'is_damaged': False,
'is_operable': True,
'license_plate': 'HN22CTV',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/bmw-1-series-hatchback-2019-128ti-5dr-step-auto-live-cockpit-professional-124008',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'BMW',
'model': '1 SERIES HATCHBACK (2019)',
'odometer': 13523,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56183,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45915,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57459,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57537,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55359,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52087,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45322,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85809,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73986,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4889488-b2c7-56a3-864c-57e24987a0ca/b4889488-b2c7-56a3-864c-57e24987a0ca_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75274,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124008/9.jpeg',
'Width': 1280}],
'price': 22600.0,
'price_includes_vat': True,
'registration_date': '2022-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1 SERIES HATCHBACK (2019) 128ti 5dr Step Auto [Live Cockpit '
'Professional]',
'transmission': 'automatic',
'trim': '128ti 5dr Step Auto [Live Cockpit Professional]',
'vin': 'WBA7L520005V08159',
'year': 2022}
2026-03-12 20:04:05 [arval.uk] INFO: Saving data for 124008: {'created_time': 1773345845.418915, 'last_price_update_time': 1773345845.418926}
2026-03-12 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124960)
2026-03-12 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67122b50>
2026-03-12 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/7.jpeg saved to cache
2026-03-12 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846
2026-03-12 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124960)
2026-03-12 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660bbfd0>
2026-03-12 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/6.jpeg saved to cache
2026-03-12 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846
2026-03-12 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124960)
2026-03-12 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713a110>
2026-03-12 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/5.jpeg saved to cache
2026-03-12 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846
2026-03-12 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124960)
2026-03-12 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713f790>
2026-03-12 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/4.jpeg saved to cache
2026-03-12 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846
2026-03-12 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124960)
2026-03-12 20:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778ce50>
2026-03-12 20:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/3.jpeg saved to cache
2026-03-12 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846
2026-03-12 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124960)
2026-03-12 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa590>
2026-03-12 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/2.jpeg saved to cache
2026-03-12 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846
2026-03-12 20:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124960)
2026-03-12 20:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c179550>
2026-03-12 20:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/1.jpeg saved to cache
2026-03-12 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846
2026-03-12 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124960)
2026-03-12 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa750>
2026-03-12 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/0.jpeg saved to cache
2026-03-12 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846
2026-03-12 20:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8d88d7d-9239-58ee-afc3-0a6bf5f27846, skipping ID generation
2026-03-12 20:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846 with scrape type 1
2026-03-12 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8d88d7d-9239-58ee-afc3-0a6bf5f27846 sending to next pipeline
2026-03-12 20:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: d8d88d7d-9239-58ee-afc3-0a6bf5f27846, identifier: 124960
2026-03-12 20:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: d8d88d7d-9239-58ee-afc3-0a6bf5f27846 with identifier: 124960
2026-03-12 20:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: d8d88d7d-9239-58ee-afc3-0a6bf5f27846 with identifier: 124960
2026-03-12 20:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: d8d88d7d-9239-58ee-afc3-0a6bf5f27846 with identifier: 124960 to the API
2026-03-12 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:04:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 242,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'd8d88d7d-9239-58ee-afc3-0a6bf5f27846',
'is_damaged': False,
'is_operable': True,
'license_plate': 'AV72NPZ',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-20-tsi-gti-5dr-124960',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 36412,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53758,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46779,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43552,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53975,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49540,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53620,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49602,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101574,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43216,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8d88d7d-9239-58ee-afc3-0a6bf5f27846/d8d88d7d-9239-58ee-afc3-0a6bf5f27846_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82500,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124960/9.jpeg',
'Width': 800}],
'price': 22700.0,
'price_includes_vat': True,
'registration_date': '2022-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 2.0 TSI GTI 5dr',
'transmission': 'manual',
'trim': '2.0 TSI GTI 5dr',
'vin': 'WVWZZZCDXPW005956',
'year': 2022}
2026-03-12 20:04:16 [arval.uk] INFO: Saving data for 124960: {'created_time': 1773345856.43933, 'last_price_update_time': 1773345856.43934}
2026-03-12 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129580)
2026-03-12 20:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66067e10>
2026-03-12 20:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/9.jpeg saved to cache
2026-03-12 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b
2026-03-12 20:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129580)
2026-03-12 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660bbb10>
2026-03-12 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/8.jpeg saved to cache
2026-03-12 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b
2026-03-12 20:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126956)
2026-03-12 20:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713fe50>
2026-03-12 20:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/9.jpeg saved to cache
2026-03-12 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2437a058-69e5-5db4-8407-47448f7909e1
2026-03-12 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126956)
2026-03-12 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a57d0>
2026-03-12 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/8.jpeg saved to cache
2026-03-12 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2437a058-69e5-5db4-8407-47448f7909e1
2026-03-12 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124732)
2026-03-12 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b9f10>
2026-03-12 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/9.jpeg saved to cache
2026-03-12 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbe329fd-641d-5af0-a216-fcd511fe6472
2026-03-12 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124732)
2026-03-12 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67718850>
2026-03-12 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/8.jpeg saved to cache
2026-03-12 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbe329fd-641d-5af0-a216-fcd511fe6472
2026-03-12 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124732)
2026-03-12 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ba950>
2026-03-12 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/7.jpeg saved to cache
2026-03-12 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbe329fd-641d-5af0-a216-fcd511fe6472
2026-03-12 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124732)
2026-03-12 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee28d0>
2026-03-12 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/6.jpeg saved to cache
2026-03-12 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbe329fd-641d-5af0-a216-fcd511fe6472
2026-03-12 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124732)
2026-03-12 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67753c90>
2026-03-12 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/5.jpeg saved to cache
2026-03-12 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbe329fd-641d-5af0-a216-fcd511fe6472
2026-03-12 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124732)
2026-03-12 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16d350>
2026-03-12 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/4.jpeg saved to cache
2026-03-12 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbe329fd-641d-5af0-a216-fcd511fe6472
2026-03-12 20:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124732)
2026-03-12 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedfd90>
2026-03-12 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/3.jpeg saved to cache
2026-03-12 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbe329fd-641d-5af0-a216-fcd511fe6472
2026-03-12 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124732)
2026-03-12 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762a750>
2026-03-12 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/2.jpeg saved to cache
2026-03-12 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbe329fd-641d-5af0-a216-fcd511fe6472
2026-03-12 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124732)
2026-03-12 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66053750>
2026-03-12 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/1.jpeg saved to cache
2026-03-12 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbe329fd-641d-5af0-a216-fcd511fe6472
2026-03-12 20:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124732)
2026-03-12 20:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660642d0>
2026-03-12 20:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/0.jpeg saved to cache
2026-03-12 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbe329fd-641d-5af0-a216-fcd511fe6472
2026-03-12 20:04:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbe329fd-641d-5af0-a216-fcd511fe6472, skipping ID generation
2026-03-12 20:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbe329fd-641d-5af0-a216-fcd511fe6472 with scrape type 1
2026-03-12 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbe329fd-641d-5af0-a216-fcd511fe6472 sending to next pipeline
2026-03-12 20:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: dbe329fd-641d-5af0-a216-fcd511fe6472, identifier: 124732
2026-03-12 20:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: dbe329fd-641d-5af0-a216-fcd511fe6472 with identifier: 124732
2026-03-12 20:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: dbe329fd-641d-5af0-a216-fcd511fe6472 with identifier: 124732
2026-03-12 20:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: dbe329fd-641d-5af0-a216-fcd511fe6472 with identifier: 124732 to the API
2026-03-12 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:04:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'dbe329fd-641d-5af0-a216-fcd511fe6472',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DE73TXH',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/seat-tarraco-estate-2019-15-ecotsi-xperience-lux-5dr-dsg-124732',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Seat',
'model': 'TARRACO ESTATE (2019)',
'odometer': 24817,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75306,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65646,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75282,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69091,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80481,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72530,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60667,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 17535,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53957,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbe329fd-641d-5af0-a216-fcd511fe6472/dbe329fd-641d-5af0-a216-fcd511fe6472_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71863,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124732/9.jpeg',
'Width': 800}],
'price': 21900.0,
'price_includes_vat': True,
'registration_date': '2023-09-27',
'seats_number': 7,
'seller_name': None,
'title': 'Seat TARRACO ESTATE (2019) 1.5 EcoTSI Xperience Lux 5dr DSG',
'transmission': 'automatic',
'trim': '1.5 EcoTSI Xperience Lux 5dr DSG',
'vin': 'VSSZZZKN3RW000450',
'year': 2023}
2026-03-12 20:04:34 [arval.uk] INFO: Saving data for 124732: {'created_time': 1773345874.297902, 'last_price_update_time': 1773345874.297912}
2026-03-12 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126956)
2026-03-12 20:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6719a850>
2026-03-12 20:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/7.jpeg saved to cache
2026-03-12 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2437a058-69e5-5db4-8407-47448f7909e1
2026-03-12 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126956)
2026-03-12 20:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124133> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660bae90>
2026-03-12 20:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/6.jpeg saved to cache
2026-03-12 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2437a058-69e5-5db4-8407-47448f7909e1
2026-03-12 20:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2 with identifier: 124133
2026-03-12 20:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2 with scrape type 1
2026-03-12 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2
2026-03-12 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/0.jpeg not downloaded yet
2026-03-12 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/1.jpeg not downloaded yet
2026-03-12 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/2.jpeg not downloaded yet
2026-03-12 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/3.jpeg not downloaded yet
2026-03-12 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/4.jpeg not downloaded yet
2026-03-12 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/5.jpeg not downloaded yet
2026-03-12 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/6.jpeg not downloaded yet
2026-03-12 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/7.jpeg not downloaded yet
2026-03-12 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/8.jpeg not downloaded yet
2026-03-12 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/9.jpeg not downloaded yet
2026-03-12 20:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126956)
2026-03-12 20:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66065050>
2026-03-12 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/5.jpeg saved to cache
2026-03-12 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2437a058-69e5-5db4-8407-47448f7909e1
2026-03-12 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127060> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccd6704b-cea6-53b9-b354-61e16dcda564 with identifier: 127060
2026-03-12 20:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccd6704b-cea6-53b9-b354-61e16dcda564 with scrape type 1
2026-03-12 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ccd6704b-cea6-53b9-b354-61e16dcda564
2026-03-12 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/0.jpeg not downloaded yet
2026-03-12 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/1.jpeg not downloaded yet
2026-03-12 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/2.jpeg not downloaded yet
2026-03-12 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/3.jpeg not downloaded yet
2026-03-12 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/4.jpeg not downloaded yet
2026-03-12 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/5.jpeg not downloaded yet
2026-03-12 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/6.jpeg not downloaded yet
2026-03-12 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/7.jpeg not downloaded yet
2026-03-12 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/8.jpeg not downloaded yet
2026-03-12 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/9.jpeg not downloaded yet
2026-03-12 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126956)
2026-03-12 20:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676325d0>
2026-03-12 20:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/4.jpeg saved to cache
2026-03-12 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2437a058-69e5-5db4-8407-47448f7909e1
2026-03-12 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124959> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:04:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ccf0187-50fb-5de8-9628-0fbf24122e0a with identifier: 124959
2026-03-12 20:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a with scrape type 1
2026-03-12 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a
2026-03-12 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/0.jpeg not downloaded yet
2026-03-12 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/1.jpeg not downloaded yet
2026-03-12 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/2.jpeg not downloaded yet
2026-03-12 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/3.jpeg not downloaded yet
2026-03-12 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/4.jpeg not downloaded yet
2026-03-12 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/5.jpeg not downloaded yet
2026-03-12 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/6.jpeg not downloaded yet
2026-03-12 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/7.jpeg not downloaded yet
2026-03-12 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/8.jpeg not downloaded yet
2026-03-12 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/9.jpeg not downloaded yet
2026-03-12 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126956)
2026-03-12 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778e390>
2026-03-12 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/3.jpeg saved to cache
2026-03-12 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2437a058-69e5-5db4-8407-47448f7909e1
2026-03-12 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126956)
2026-03-12 20:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6761fc10>
2026-03-12 20:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/2.jpeg saved to cache
2026-03-12 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2437a058-69e5-5db4-8407-47448f7909e1
2026-03-12 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126956)
2026-03-12 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cededd0>
2026-03-12 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/1.jpeg saved to cache
2026-03-12 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2437a058-69e5-5db4-8407-47448f7909e1
2026-03-12 20:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126956)
2026-03-12 20:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16d810>
2026-03-12 20:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/0.jpeg saved to cache
2026-03-12 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2437a058-69e5-5db4-8407-47448f7909e1
2026-03-12 20:04:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2437a058-69e5-5db4-8407-47448f7909e1, skipping ID generation
2026-03-12 20:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2437a058-69e5-5db4-8407-47448f7909e1 with scrape type 1
2026-03-12 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2437a058-69e5-5db4-8407-47448f7909e1 sending to next pipeline
2026-03-12 20:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 2437a058-69e5-5db4-8407-47448f7909e1, identifier: 126956
2026-03-12 20:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 2437a058-69e5-5db4-8407-47448f7909e1 with identifier: 126956
2026-03-12 20:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 2437a058-69e5-5db4-8407-47448f7909e1 with identifier: 126956
2026-03-12 20:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 2437a058-69e5-5db4-8407-47448f7909e1 with identifier: 126956 to the API
2026-03-12 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:04:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '2437a058-69e5-5db4-8407-47448f7909e1',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YC72XXY',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-a3-sportback-2020-35-tfsi-s-line-5dr-s-tronic-126956',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'A3 SPORTBACK (2020)',
'odometer': 11755,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44532,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44954,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54709,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40225,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47451,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83327,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37606,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58616,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40969,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2437a058-69e5-5db4-8407-47448f7909e1/2437a058-69e5-5db4-8407-47448f7909e1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55320,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126956/9.jpeg',
'Width': 800}],
'price': 22400.0,
'price_includes_vat': True,
'registration_date': '2022-10-23',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 SPORTBACK (2020) 35 TFSI S line 5dr S Tronic',
'transmission': 'automatic',
'trim': '35 TFSI S line 5dr S Tronic',
'vin': 'WAUZZZGY3PA025246',
'year': 2022}
2026-03-12 20:04:44 [arval.uk] INFO: Saving data for 126956: {'created_time': 1773345884.445313, 'last_price_update_time': 1773345884.445322}
2026-03-12 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129580)
2026-03-12 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67604910>
2026-03-12 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/7.jpeg saved to cache
2026-03-12 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b
2026-03-12 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129580)
2026-03-12 20:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a6e10>
2026-03-12 20:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/6.jpeg saved to cache
2026-03-12 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b
2026-03-12 20:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129580)
2026-03-12 20:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67647190>
2026-03-12 20:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/5.jpeg saved to cache
2026-03-12 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b
2026-03-12 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129580)
2026-03-12 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67604f10>
2026-03-12 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/4.jpeg saved to cache
2026-03-12 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b
2026-03-12 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129580)
2026-03-12 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67138c10>
2026-03-12 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/3.jpeg saved to cache
2026-03-12 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b
2026-03-12 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129580)
2026-03-12 20:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ae390>
2026-03-12 20:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/2.jpeg saved to cache
2026-03-12 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b
2026-03-12 20:04:51 [scrapy.extensions.logstats] INFO: Crawled 76 pages (at 5 pages/min), scraped 43 items (at 5 items/min)
2026-03-12 20:04:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129580)
2026-03-12 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a24d0>
2026-03-12 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/1.jpeg saved to cache
2026-03-12 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b
2026-03-12 20:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129580)
2026-03-12 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67139010>
2026-03-12 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/0.jpeg saved to cache
2026-03-12 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b
2026-03-12 20:04:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfa93ee1-373c-5ea3-ae1c-b3655f02124b, skipping ID generation
2026-03-12 20:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b with scrape type 1
2026-03-12 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfa93ee1-373c-5ea3-ae1c-b3655f02124b sending to next pipeline
2026-03-12 20:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: dfa93ee1-373c-5ea3-ae1c-b3655f02124b, identifier: 129580
2026-03-12 20:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: dfa93ee1-373c-5ea3-ae1c-b3655f02124b with identifier: 129580
2026-03-12 20:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: dfa93ee1-373c-5ea3-ae1c-b3655f02124b with identifier: 129580
2026-03-12 20:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: dfa93ee1-373c-5ea3-ae1c-b3655f02124b with identifier: 129580 to the API
2026-03-12 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:04:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'dfa93ee1-373c-5ea3-ae1c-b3655f02124b',
'is_damaged': False,
'is_operable': True,
'license_plate': 'VN73ZND',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-15-etsi-150-r-line-5dr-dsg-129580',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 12534,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96784,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75131,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96398,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112759,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100536,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85007,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93688,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102293,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74830,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfa93ee1-373c-5ea3-ae1c-b3655f02124b/dfa93ee1-373c-5ea3-ae1c-b3655f02124b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105450,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129580/9.jpeg',
'Width': 800}],
'price': 22400.0,
'price_includes_vat': True,
'registration_date': '2023-12-18',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 1.5 eTSI 150 R-Line 5dr DSG',
'transmission': 'automatic',
'trim': '1.5 eTSI 150 R-Line 5dr DSG',
'vin': 'WVWZZZCD2RW145860',
'year': 2023}
2026-03-12 20:04:54 [arval.uk] INFO: Saving data for 129580: {'created_time': 1773345894.589129, 'last_price_update_time': 1773345894.589137}
2026-03-12 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124133)
2026-03-12 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c1784d0>
2026-03-12 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/9.jpeg saved to cache
2026-03-12 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2
2026-03-12 20:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124133)
2026-03-12 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67606f90>
2026-03-12 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/8.jpeg saved to cache
2026-03-12 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2
2026-03-12 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127060)
2026-03-12 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a99d0>
2026-03-12 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/9.jpeg saved to cache
2026-03-12 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ccd6704b-cea6-53b9-b354-61e16dcda564
2026-03-12 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127060)
2026-03-12 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676053d0>
2026-03-12 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:04:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:04:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/8.jpeg saved to cache
2026-03-12 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ccd6704b-cea6-53b9-b354-61e16dcda564
2026-03-12 20:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124959)
2026-03-12 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a9510>
2026-03-12 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/9.jpeg saved to cache
2026-03-12 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a
2026-03-12 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124959)
2026-03-12 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67607ad0>
2026-03-12 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/8.jpeg saved to cache
2026-03-12 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a
2026-03-12 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124959)
2026-03-12 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660bba10>
2026-03-12 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/7.jpeg saved to cache
2026-03-12 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a
2026-03-12 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124959)
2026-03-12 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16ce90>
2026-03-12 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/6.jpeg saved to cache
2026-03-12 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a
2026-03-12 20:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124959)
2026-03-12 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f671391d0>
2026-03-12 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/5.jpeg saved to cache
2026-03-12 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a
2026-03-12 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124959)
2026-03-12 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763a610>
2026-03-12 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/4.jpeg saved to cache
2026-03-12 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a
2026-03-12 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124959)
2026-03-12 20:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a8dd0>
2026-03-12 20:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/3.jpeg saved to cache
2026-03-12 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a
2026-03-12 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124959)
2026-03-12 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6761e690>
2026-03-12 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/2.jpeg saved to cache
2026-03-12 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a
2026-03-12 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124959)
2026-03-12 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f79c10>
2026-03-12 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/1.jpeg saved to cache
2026-03-12 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a
2026-03-12 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124959)
2026-03-12 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c178950>
2026-03-12 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/0.jpeg saved to cache
2026-03-12 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a
2026-03-12 20:05:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ccf0187-50fb-5de8-9628-0fbf24122e0a, skipping ID generation
2026-03-12 20:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a with scrape type 1
2026-03-12 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ccf0187-50fb-5de8-9628-0fbf24122e0a sending to next pipeline
2026-03-12 20:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 8ccf0187-50fb-5de8-9628-0fbf24122e0a, identifier: 124959
2026-03-12 20:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 8ccf0187-50fb-5de8-9628-0fbf24122e0a with identifier: 124959
2026-03-12 20:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 8ccf0187-50fb-5de8-9628-0fbf24122e0a with identifier: 124959
2026-03-12 20:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 8ccf0187-50fb-5de8-9628-0fbf24122e0a with identifier: 124959 to the API
2026-03-12 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:05:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '8ccf0187-50fb-5de8-9628-0fbf24122e0a',
'is_damaged': False,
'is_operable': True,
'license_plate': 'KP23FXC',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-a3-sportback-2020-35-tfsi-s-line-5dr-s-tronic-124959',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'A3 SPORTBACK (2020)',
'odometer': 19251,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42892,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37848,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41455,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38103,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50590,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38326,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43341,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42496,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96631,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ccf0187-50fb-5de8-9628-0fbf24122e0a/8ccf0187-50fb-5de8-9628-0fbf24122e0a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72616,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124959/9.jpeg',
'Width': 800}],
'price': 21400.0,
'price_includes_vat': True,
'registration_date': '2023-04-05',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 SPORTBACK (2020) 35 TFSI S line 5dr S Tronic',
'transmission': 'automatic',
'trim': '35 TFSI S line 5dr S Tronic',
'vin': 'WAUZZZGY4PA080188',
'year': 2023}
2026-03-12 20:05:12 [arval.uk] INFO: Saving data for 124959: {'created_time': 1773345912.162932, 'last_price_update_time': 1773345912.162941}
2026-03-12 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127060)
2026-03-12 20:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67632190>
2026-03-12 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/7.jpeg saved to cache
2026-03-12 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ccd6704b-cea6-53b9-b354-61e16dcda564
2026-03-12 20:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127174> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127060)
2026-03-12 20:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35353381-a430-5ba0-b50a-d67c303fc3be with identifier: 127174
2026-03-12 20:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35353381-a430-5ba0-b50a-d67c303fc3be with scrape type 1
2026-03-12 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35353381-a430-5ba0-b50a-d67c303fc3be
2026-03-12 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/0.jpeg not downloaded yet
2026-03-12 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/1.jpeg not downloaded yet
2026-03-12 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/2.jpeg not downloaded yet
2026-03-12 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/3.jpeg not downloaded yet
2026-03-12 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/4.jpeg not downloaded yet
2026-03-12 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/5.jpeg not downloaded yet
2026-03-12 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/6.jpeg not downloaded yet
2026-03-12 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676447d0>
2026-03-12 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/6.jpeg saved to cache
2026-03-12 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ccd6704b-cea6-53b9-b354-61e16dcda564
2026-03-12 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/7.jpeg not downloaded yet
2026-03-12 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/8.jpeg not downloaded yet
2026-03-12 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/9.jpeg not downloaded yet
2026-03-12 20:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127060)
2026-03-12 20:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f345d0>
2026-03-12 20:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/5.jpeg saved to cache
2026-03-12 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ccd6704b-cea6-53b9-b354-61e16dcda564
2026-03-12 20:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126261> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0cb968a-f637-5744-ab2a-31a10016f463 with identifier: 126261
2026-03-12 20:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0cb968a-f637-5744-ab2a-31a10016f463 with scrape type 1
2026-03-12 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0cb968a-f637-5744-ab2a-31a10016f463
2026-03-12 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/0.jpeg not downloaded yet
2026-03-12 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/1.jpeg not downloaded yet
2026-03-12 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/2.jpeg not downloaded yet
2026-03-12 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/3.jpeg not downloaded yet
2026-03-12 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/4.jpeg not downloaded yet
2026-03-12 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/5.jpeg not downloaded yet
2026-03-12 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/6.jpeg not downloaded yet
2026-03-12 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/7.jpeg not downloaded yet
2026-03-12 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/8.jpeg not downloaded yet
2026-03-12 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/9.jpeg not downloaded yet
2026-03-12 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127060)
2026-03-12 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f37bd0>
2026-03-12 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/4.jpeg saved to cache
2026-03-12 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ccd6704b-cea6-53b9-b354-61e16dcda564
2026-03-12 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124544> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c with identifier: 124544
2026-03-12 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c with scrape type 1
2026-03-12 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c
2026-03-12 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/0.jpeg not downloaded yet
2026-03-12 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/1.jpeg not downloaded yet
2026-03-12 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/2.jpeg not downloaded yet
2026-03-12 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/3.jpeg not downloaded yet
2026-03-12 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/4.jpeg not downloaded yet
2026-03-12 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/5.jpeg not downloaded yet
2026-03-12 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/6.jpeg not downloaded yet
2026-03-12 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/7.jpeg not downloaded yet
2026-03-12 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/8.jpeg not downloaded yet
2026-03-12 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/9.jpeg not downloaded yet
2026-03-12 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127060)
2026-03-12 20:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67645c10>
2026-03-12 20:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/3.jpeg saved to cache
2026-03-12 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ccd6704b-cea6-53b9-b354-61e16dcda564
2026-03-12 20:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127060)
2026-03-12 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67123210>
2026-03-12 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/2.jpeg saved to cache
2026-03-12 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ccd6704b-cea6-53b9-b354-61e16dcda564
2026-03-12 20:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127060)
2026-03-12 20:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c147e50>
2026-03-12 20:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/1.jpeg saved to cache
2026-03-12 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ccd6704b-cea6-53b9-b354-61e16dcda564
2026-03-12 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127060)
2026-03-12 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67631510>
2026-03-12 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/0.jpeg saved to cache
2026-03-12 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ccd6704b-cea6-53b9-b354-61e16dcda564
2026-03-12 20:05:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ccd6704b-cea6-53b9-b354-61e16dcda564, skipping ID generation
2026-03-12 20:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccd6704b-cea6-53b9-b354-61e16dcda564 with scrape type 1
2026-03-12 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ccd6704b-cea6-53b9-b354-61e16dcda564 sending to next pipeline
2026-03-12 20:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: ccd6704b-cea6-53b9-b354-61e16dcda564, identifier: 127060
2026-03-12 20:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: ccd6704b-cea6-53b9-b354-61e16dcda564 with identifier: 127060
2026-03-12 20:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: ccd6704b-cea6-53b9-b354-61e16dcda564 with identifier: 127060
2026-03-12 20:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: ccd6704b-cea6-53b9-b354-61e16dcda564 with identifier: 127060 to the API
2026-03-12 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:05:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'ccd6704b-cea6-53b9-b354-61e16dcda564',
'is_damaged': False,
'is_operable': True,
'license_plate': 'RF72SNK',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-15-etsi-150-r-line-5dr-dsg-127060',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 17771,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106790,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87666,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100133,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78486,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96406,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96530,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93292,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93470,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79769,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccd6704b-cea6-53b9-b354-61e16dcda564/ccd6704b-cea6-53b9-b354-61e16dcda564_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62638,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127060/9.jpeg',
'Width': 800}],
'price': 21400.0,
'price_includes_vat': True,
'registration_date': '2023-01-18',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 1.5 eTSI 150 R-Line 5dr DSG',
'transmission': 'automatic',
'trim': '1.5 eTSI 150 R-Line 5dr DSG',
'vin': 'WVWZZZCD1PW115472',
'year': 2023}
2026-03-12 20:05:21 [arval.uk] INFO: Saving data for 127060: {'created_time': 1773345921.847569, 'last_price_update_time': 1773345921.847578}
2026-03-12 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124133)
2026-03-12 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4e610>
2026-03-12 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/7.jpeg saved to cache
2026-03-12 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2
2026-03-12 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124133)
2026-03-12 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713a750>
2026-03-12 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/6.jpeg saved to cache
2026-03-12 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2
2026-03-12 20:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124133)
2026-03-12 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a4a50>
2026-03-12 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/5.jpeg saved to cache
2026-03-12 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2
2026-03-12 20:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124133)
2026-03-12 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c12fa50>
2026-03-12 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/4.jpeg saved to cache
2026-03-12 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2
2026-03-12 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124133)
2026-03-12 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66067ad0>
2026-03-12 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/3.jpeg saved to cache
2026-03-12 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2
2026-03-12 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124133)
2026-03-12 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c1169d0>
2026-03-12 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/2.jpeg saved to cache
2026-03-12 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2
2026-03-12 20:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124133)
2026-03-12 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbef390>
2026-03-12 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/1.jpeg saved to cache
2026-03-12 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2
2026-03-12 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124133)
2026-03-12 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6761e850>
2026-03-12 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/0.jpeg saved to cache
2026-03-12 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2
2026-03-12 20:05:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2, skipping ID generation
2026-03-12 20:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2 with scrape type 1
2026-03-12 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2 sending to next pipeline
2026-03-12 20:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2, identifier: 124133
2026-03-12 20:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2 with identifier: 124133
2026-03-12 20:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2 with identifier: 124133
2026-03-12 20:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2 with identifier: 124133 to the API
2026-03-12 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:05:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 181,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': 'e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2',
'is_damaged': False,
'is_operable': True,
'license_plate': 'SJ72XVF',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/lexus-ux-hatchback-2019-250h-e4-20-f-sport-5dr-cvt-premium-plussunroof-124133',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Lexus',
'model': 'UX HATCHBACK (2019)',
'odometer': 21192,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62865,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64474,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59916,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49548,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51754,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161863,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54501,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104871,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97297,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2/e52c9b76-c3eb-5b4c-86c7-96bfa3f8e9b2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85652,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124133/9.jpeg',
'Width': 1280}],
'price': 21900.0,
'price_includes_vat': True,
'registration_date': '2022-11-23',
'seats_number': 5,
'seller_name': None,
'title': 'Lexus UX HATCHBACK (2019) 250h E4 2.0 F-Sport 5dr CVT [Premium '
'Plus/Sunroof]',
'transmission': 'automatic',
'trim': '250h E4 2.0 F-Sport 5dr CVT [Premium Plus/Sunroof]',
'vin': 'JTHU95BHX02062404',
'year': 2022}
2026-03-12 20:05:31 [arval.uk] INFO: Saving data for 124133: {'created_time': 1773345931.842331, 'last_price_update_time': 1773345931.84234}
2026-03-12 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127174)
2026-03-12 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16c610>
2026-03-12 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/9.jpeg saved to cache
2026-03-12 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 35353381-a430-5ba0-b50a-d67c303fc3be
2026-03-12 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127174)
2026-03-12 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbeeb90>
2026-03-12 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/8.jpeg saved to cache
2026-03-12 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 35353381-a430-5ba0-b50a-d67c303fc3be
2026-03-12 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126261)
2026-03-12 20:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67647150>
2026-03-12 20:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/9.jpeg saved to cache
2026-03-12 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0cb968a-f637-5744-ab2a-31a10016f463
2026-03-12 20:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126261)
2026-03-12 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbeff10>
2026-03-12 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/8.jpeg saved to cache
2026-03-12 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0cb968a-f637-5744-ab2a-31a10016f463
2026-03-12 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124544)
2026-03-12 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67120d10>
2026-03-12 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/9.jpeg saved to cache
2026-03-12 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c
2026-03-12 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124544)
2026-03-12 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677659d0>
2026-03-12 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/8.jpeg saved to cache
2026-03-12 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c
2026-03-12 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124544)
2026-03-12 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6761df50>
2026-03-12 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/7.jpeg saved to cache
2026-03-12 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c
2026-03-12 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124544)
2026-03-12 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677726d0>
2026-03-12 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/6.jpeg saved to cache
2026-03-12 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c
2026-03-12 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124544)
2026-03-12 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16c250>
2026-03-12 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/5.jpeg saved to cache
2026-03-12 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c
2026-03-12 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124544)
2026-03-12 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67772950>
2026-03-12 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/4.jpeg saved to cache
2026-03-12 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c
2026-03-12 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124544)
2026-03-12 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16e990>
2026-03-12 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/3.jpeg saved to cache
2026-03-12 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c
2026-03-12 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124544)
2026-03-12 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66080c90>
2026-03-12 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/2.jpeg saved to cache
2026-03-12 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c
2026-03-12 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124544)
2026-03-12 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763ae90>
2026-03-12 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/1.jpeg saved to cache
2026-03-12 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c
2026-03-12 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124544)
2026-03-12 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6d0c2890>
2026-03-12 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/0.jpeg saved to cache
2026-03-12 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c
2026-03-12 20:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c, skipping ID generation
2026-03-12 20:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c with scrape type 1
2026-03-12 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c sending to next pipeline
2026-03-12 20:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c, identifier: 124544
2026-03-12 20:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c with identifier: 124544
2026-03-12 20:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c with identifier: 124544
2026-03-12 20:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c with identifier: 124544 to the API
2026-03-12 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:05:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'engine_horse_power': 242,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': '61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c',
'is_damaged': False,
'is_operable': True,
'license_plate': 'VN72XPU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-14-tsi-gte-5dr-dsg-124544',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 14830,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65328,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61463,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58010,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49520,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51228,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175751,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77050,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102053,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91518,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c/61f0ed8f-d8b3-5288-9c8f-2dc28b388b8c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91732,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124544/9.jpeg',
'Width': 1280}],
'price': 20500.0,
'price_includes_vat': True,
'registration_date': '2022-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 1.4 TSI GTE 5dr DSG',
'transmission': 'automatic',
'trim': '1.4 TSI GTE 5dr DSG',
'vin': 'WVWZZZCD1PW306941',
'year': 2022}
2026-03-12 20:05:48 [arval.uk] INFO: Saving data for 124544: {'created_time': 1773345948.915417, 'last_price_update_time': 1773345948.915426}
2026-03-12 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126261)
2026-03-12 20:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67145bd0>
2026-03-12 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/7.jpeg saved to cache
2026-03-12 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0cb968a-f637-5744-ab2a-31a10016f463
2026-03-12 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126261)
2026-03-12 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766c350>
2026-03-12 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/6.jpeg saved to cache
2026-03-12 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0cb968a-f637-5744-ab2a-31a10016f463
2026-03-12 20:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130276> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126261)
2026-03-12 20:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65325aea-8504-58e6-9ec6-2f30ba424c6b with identifier: 130276
2026-03-12 20:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65325aea-8504-58e6-9ec6-2f30ba424c6b with scrape type 1
2026-03-12 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65325aea-8504-58e6-9ec6-2f30ba424c6b
2026-03-12 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/0.jpeg not downloaded yet
2026-03-12 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/1.jpeg not downloaded yet
2026-03-12 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/2.jpeg not downloaded yet
2026-03-12 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/3.jpeg not downloaded yet
2026-03-12 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/4.jpeg not downloaded yet
2026-03-12 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/5.jpeg not downloaded yet
2026-03-12 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/6.jpeg not downloaded yet
2026-03-12 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f346d0>
2026-03-12 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/5.jpeg saved to cache
2026-03-12 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0cb968a-f637-5744-ab2a-31a10016f463
2026-03-12 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/7.jpeg not downloaded yet
2026-03-12 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/8.jpeg not downloaded yet
2026-03-12 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/9.jpeg not downloaded yet
2026-03-12 20:05:51 [scrapy.extensions.logstats] INFO: Crawled 80 pages (at 4 pages/min), scraped 48 items (at 5 items/min)
2026-03-12 20:05:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126261)
2026-03-12 20:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f54a10>
2026-03-12 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/4.jpeg saved to cache
2026-03-12 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0cb968a-f637-5744-ab2a-31a10016f463
2026-03-12 20:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126261)
2026-03-12 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedf290>
2026-03-12 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/3.jpeg saved to cache
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0cb968a-f637-5744-ab2a-31a10016f463
2026-03-12 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121431> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0d0186d-ca06-5436-9c6f-f48ace161702 with identifier: 121431
2026-03-12 20:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0d0186d-ca06-5436-9c6f-f48ace161702 with scrape type 1
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f0d0186d-ca06-5436-9c6f-f48ace161702
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/0.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/1.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/2.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/3.jpeg not downloaded yet
2026-03-12 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129479> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/4.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/5.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/6.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/7.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/8.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/9.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 494cc595-91f7-5b18-b56b-1b81d65ad427 with identifier: 129479
2026-03-12 20:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 494cc595-91f7-5b18-b56b-1b81d65ad427 with scrape type 1
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 494cc595-91f7-5b18-b56b-1b81d65ad427
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/0.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/1.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/2.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/3.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/4.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/5.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/6.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/7.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/8.jpeg not downloaded yet
2026-03-12 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/9.jpeg not downloaded yet
2026-03-12 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126261)
2026-03-12 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f54cd0>
2026-03-12 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/2.jpeg saved to cache
2026-03-12 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0cb968a-f637-5744-ab2a-31a10016f463
2026-03-12 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126261)
2026-03-12 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6602de90>
2026-03-12 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/1.jpeg saved to cache
2026-03-12 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0cb968a-f637-5744-ab2a-31a10016f463
2026-03-12 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128151> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53e2642a-66d3-5c81-9adb-82d309b8879e with identifier: 128151
2026-03-12 20:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53e2642a-66d3-5c81-9adb-82d309b8879e with scrape type 1
2026-03-12 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53e2642a-66d3-5c81-9adb-82d309b8879e
2026-03-12 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/0.jpeg not downloaded yet
2026-03-12 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/1.jpeg not downloaded yet
2026-03-12 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/2.jpeg not downloaded yet
2026-03-12 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/3.jpeg not downloaded yet
2026-03-12 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/4.jpeg not downloaded yet
2026-03-12 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/5.jpeg not downloaded yet
2026-03-12 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/6.jpeg not downloaded yet
2026-03-12 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/7.jpeg not downloaded yet
2026-03-12 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/8.jpeg not downloaded yet
2026-03-12 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/9.jpeg not downloaded yet
2026-03-12 20:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126261)
2026-03-12 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677188d0>
2026-03-12 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/0.jpeg saved to cache
2026-03-12 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0cb968a-f637-5744-ab2a-31a10016f463
2026-03-12 20:05:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0cb968a-f637-5744-ab2a-31a10016f463, skipping ID generation
2026-03-12 20:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0cb968a-f637-5744-ab2a-31a10016f463 with scrape type 1
2026-03-12 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0cb968a-f637-5744-ab2a-31a10016f463 sending to next pipeline
2026-03-12 20:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: b0cb968a-f637-5744-ab2a-31a10016f463, identifier: 126261
2026-03-12 20:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: b0cb968a-f637-5744-ab2a-31a10016f463 with identifier: 126261
2026-03-12 20:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: b0cb968a-f637-5744-ab2a-31a10016f463 with identifier: 126261
2026-03-12 20:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: b0cb968a-f637-5744-ab2a-31a10016f463 with identifier: 126261 to the API
2026-03-12 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:05:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'b0cb968a-f637-5744-ab2a-31a10016f463',
'is_damaged': False,
'is_operable': True,
'license_plate': 'VK73YHM',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-15-etsi-150-r-line-5dr-dsg-126261',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 28864,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89121,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83307,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94024,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78426,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89022,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78611,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82334,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81886,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81886,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b0cb968a-f637-5744-ab2a-31a10016f463/b0cb968a-f637-5744-ab2a-31a10016f463_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97606,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126261/9.jpeg',
'Width': 800}],
'price': 20600.0,
'price_includes_vat': True,
'registration_date': '2023-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 1.5 eTSI 150 R-Line 5dr DSG',
'transmission': 'automatic',
'trim': '1.5 eTSI 150 R-Line 5dr DSG',
'vin': 'WVWZZZCD7RW017582',
'year': 2023}
2026-03-12 20:05:58 [arval.uk] INFO: Saving data for 126261: {'created_time': 1773345958.627147, 'last_price_update_time': 1773345958.627158}
2026-03-12 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127174)
2026-03-12 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778f310>
2026-03-12 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/7.jpeg saved to cache
2026-03-12 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35353381-a430-5ba0-b50a-d67c303fc3be
2026-03-12 20:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127174)
2026-03-12 20:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb3790>
2026-03-12 20:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/6.jpeg saved to cache
2026-03-12 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 35353381-a430-5ba0-b50a-d67c303fc3be
2026-03-12 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127174)
2026-03-12 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717afd0>
2026-03-12 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/5.jpeg saved to cache
2026-03-12 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35353381-a430-5ba0-b50a-d67c303fc3be
2026-03-12 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127174)
2026-03-12 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712e810>
2026-03-12 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/4.jpeg saved to cache
2026-03-12 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35353381-a430-5ba0-b50a-d67c303fc3be
2026-03-12 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127174)
2026-03-12 20:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c114f90>
2026-03-12 20:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/3.jpeg saved to cache
2026-03-12 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35353381-a430-5ba0-b50a-d67c303fc3be
2026-03-12 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127174)
2026-03-12 20:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67604890>
2026-03-12 20:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/2.jpeg saved to cache
2026-03-12 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35353381-a430-5ba0-b50a-d67c303fc3be
2026-03-12 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127174)
2026-03-12 20:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5f450>
2026-03-12 20:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/1.jpeg saved to cache
2026-03-12 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35353381-a430-5ba0-b50a-d67c303fc3be
2026-03-12 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127174)
2026-03-12 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717a7d0>
2026-03-12 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/0.jpeg saved to cache
2026-03-12 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35353381-a430-5ba0-b50a-d67c303fc3be
2026-03-12 20:06:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35353381-a430-5ba0-b50a-d67c303fc3be, skipping ID generation
2026-03-12 20:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35353381-a430-5ba0-b50a-d67c303fc3be with scrape type 1
2026-03-12 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35353381-a430-5ba0-b50a-d67c303fc3be sending to next pipeline
2026-03-12 20:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 35353381-a430-5ba0-b50a-d67c303fc3be, identifier: 127174
2026-03-12 20:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 35353381-a430-5ba0-b50a-d67c303fc3be with identifier: 127174
2026-03-12 20:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 35353381-a430-5ba0-b50a-d67c303fc3be with identifier: 127174
2026-03-12 20:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 35353381-a430-5ba0-b50a-d67c303fc3be with identifier: 127174 to the API
2026-03-12 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:06:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 224,
'expiration_date': None,
'fuel_type': 'Electric',
'id': '35353381-a430-5ba0-b50a-d67c303fc3be',
'is_damaged': False,
'is_operable': True,
'license_plate': 'RF72KJV',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/mercedes-eqb-estate-2021-eqb-300-4matic-168kw-amg-line-665kwh-5dr-auto-127174',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Mercedes',
'model': 'EQB ESTATE (2021)',
'odometer': 44913,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48005,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40139,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48116,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48340,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38539,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49654,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56270,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83560,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44489,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35353381-a430-5ba0-b50a-d67c303fc3be/35353381-a430-5ba0-b50a-d67c303fc3be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52044,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127174/9.jpeg',
'Width': 800}],
'price': 21300.0,
'price_includes_vat': True,
'registration_date': '2023-01-19',
'seats_number': 7,
'seller_name': None,
'title': 'Mercedes EQB ESTATE (2021) EQB 300 4Matic 168kW AMG Line 66.5kWh '
'5dr Auto',
'transmission': 'automatic',
'trim': 'EQB 300 4Matic 168kW AMG Line 66.5kWh 5dr Auto',
'vin': 'W1N9M0JB1PN028732',
'year': 2023}
2026-03-12 20:06:08 [arval.uk] INFO: Saving data for 127174: {'created_time': 1773345968.567501, 'last_price_update_time': 1773345968.567511}
2026-03-12 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130276)
2026-03-12 20:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18f450>
2026-03-12 20:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/9.jpeg saved to cache
2026-03-12 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65325aea-8504-58e6-9ec6-2f30ba424c6b
2026-03-12 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130276)
2026-03-12 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717a890>
2026-03-12 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/8.jpeg saved to cache
2026-03-12 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65325aea-8504-58e6-9ec6-2f30ba424c6b
2026-03-12 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130276)
2026-03-12 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766f410>
2026-03-12 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/7.jpeg saved to cache
2026-03-12 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65325aea-8504-58e6-9ec6-2f30ba424c6b
2026-03-12 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121431)
2026-03-12 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67604850>
2026-03-12 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/3.jpeg saved to cache
2026-03-12 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0d0186d-ca06-5436-9c6f-f48ace161702
2026-03-12 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129479)
2026-03-12 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4d8d0>
2026-03-12 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/9.jpeg saved to cache
2026-03-12 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 494cc595-91f7-5b18-b56b-1b81d65ad427
2026-03-12 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129479)
2026-03-12 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f56590>
2026-03-12 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/8.jpeg saved to cache
2026-03-12 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 494cc595-91f7-5b18-b56b-1b81d65ad427
2026-03-12 20:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129479)
2026-03-12 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778e290>
2026-03-12 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/7.jpeg saved to cache
2026-03-12 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 494cc595-91f7-5b18-b56b-1b81d65ad427
2026-03-12 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128151)
2026-03-12 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18f290>
2026-03-12 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/9.jpeg saved to cache
2026-03-12 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53e2642a-66d3-5c81-9adb-82d309b8879e
2026-03-12 20:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128151)
2026-03-12 20:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766cd50>
2026-03-12 20:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/8.jpeg saved to cache
2026-03-12 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53e2642a-66d3-5c81-9adb-82d309b8879e
2026-03-12 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128151)
2026-03-12 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67605d50>
2026-03-12 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/7.jpeg saved to cache
2026-03-12 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53e2642a-66d3-5c81-9adb-82d309b8879e
2026-03-12 20:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128151)
2026-03-12 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604ef90>
2026-03-12 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/6.jpeg saved to cache
2026-03-12 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53e2642a-66d3-5c81-9adb-82d309b8879e
2026-03-12 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128151)
2026-03-12 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f567d0>
2026-03-12 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/5.jpeg saved to cache
2026-03-12 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53e2642a-66d3-5c81-9adb-82d309b8879e
2026-03-12 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128151)
2026-03-12 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbef290>
2026-03-12 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/4.jpeg saved to cache
2026-03-12 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53e2642a-66d3-5c81-9adb-82d309b8879e
2026-03-12 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128151)
2026-03-12 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67606b90>
2026-03-12 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/3.jpeg saved to cache
2026-03-12 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53e2642a-66d3-5c81-9adb-82d309b8879e
2026-03-12 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128151)
2026-03-12 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717a090>
2026-03-12 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/2.jpeg saved to cache
2026-03-12 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53e2642a-66d3-5c81-9adb-82d309b8879e
2026-03-12 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128151)
2026-03-12 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f57cd0>
2026-03-12 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/1.jpeg saved to cache
2026-03-12 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53e2642a-66d3-5c81-9adb-82d309b8879e
2026-03-12 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128151)
2026-03-12 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c147790>
2026-03-12 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/0.jpeg saved to cache
2026-03-12 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53e2642a-66d3-5c81-9adb-82d309b8879e
2026-03-12 20:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53e2642a-66d3-5c81-9adb-82d309b8879e, skipping ID generation
2026-03-12 20:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53e2642a-66d3-5c81-9adb-82d309b8879e with scrape type 1
2026-03-12 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53e2642a-66d3-5c81-9adb-82d309b8879e sending to next pipeline
2026-03-12 20:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 53e2642a-66d3-5c81-9adb-82d309b8879e, identifier: 128151
2026-03-12 20:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 53e2642a-66d3-5c81-9adb-82d309b8879e with identifier: 128151
2026-03-12 20:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 53e2642a-66d3-5c81-9adb-82d309b8879e with identifier: 128151
2026-03-12 20:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 53e2642a-66d3-5c81-9adb-82d309b8879e with identifier: 128151 to the API
2026-03-12 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:06:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 201,
'expiration_date': None,
'fuel_type': 'Electric',
'id': '53e2642a-66d3-5c81-9adb-82d309b8879e',
'is_damaged': False,
'is_operable': True,
'license_plate': 'WG71ECN',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-q4-e-tron-estate-2021-150kw-40-8277kwh-s-line-5dr-auto-cs-128151',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'Q4 E-TRON ESTATE (2021)',
'odometer': 39678,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57801,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53070,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60678,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55992,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55673,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49867,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57820,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54487,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38594,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53e2642a-66d3-5c81-9adb-82d309b8879e/53e2642a-66d3-5c81-9adb-82d309b8879e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73024,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128151/9.jpeg',
'Width': 800}],
'price': 19400.0,
'price_includes_vat': True,
'registration_date': '2021-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q4 E-TRON ESTATE (2021) 150kW 40 82.77kWh S Line 5dr Auto '
'[C+S]',
'transmission': 'automatic',
'trim': '150kW 40 82.77kWh S Line 5dr Auto [C+S]',
'vin': 'WAUZZZFZ5NP019856',
'year': 2021}
2026-03-12 20:06:29 [arval.uk] INFO: Saving data for 128151: {'created_time': 1773345989.041368, 'last_price_update_time': 1773345989.041377}
2026-03-12 20:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129479)
2026-03-12 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67178bd0>
2026-03-12 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/6.jpeg saved to cache
2026-03-12 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 494cc595-91f7-5b18-b56b-1b81d65ad427
2026-03-12 20:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129479)
2026-03-12 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbf53d0>
2026-03-12 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/5.jpeg saved to cache
2026-03-12 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 494cc595-91f7-5b18-b56b-1b81d65ad427
2026-03-12 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129479)
2026-03-12 20:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6602c910>
2026-03-12 20:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/4.jpeg saved to cache
2026-03-12 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 494cc595-91f7-5b18-b56b-1b81d65ad427
2026-03-12 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129479)
2026-03-12 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb3bd0>
2026-03-12 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/3.jpeg saved to cache
2026-03-12 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 494cc595-91f7-5b18-b56b-1b81d65ad427
2026-03-12 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129479)
2026-03-12 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6602c350>
2026-03-12 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/2.jpeg saved to cache
2026-03-12 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 494cc595-91f7-5b18-b56b-1b81d65ad427
2026-03-12 20:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129479)
2026-03-12 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedfbd0>
2026-03-12 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/1.jpeg saved to cache
2026-03-12 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 494cc595-91f7-5b18-b56b-1b81d65ad427
2026-03-12 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129479)
2026-03-12 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67606a50>
2026-03-12 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/0.jpeg saved to cache
2026-03-12 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 494cc595-91f7-5b18-b56b-1b81d65ad427
2026-03-12 20:06:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 494cc595-91f7-5b18-b56b-1b81d65ad427, skipping ID generation
2026-03-12 20:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 494cc595-91f7-5b18-b56b-1b81d65ad427 with scrape type 1
2026-03-12 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 494cc595-91f7-5b18-b56b-1b81d65ad427 sending to next pipeline
2026-03-12 20:06:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 494cc595-91f7-5b18-b56b-1b81d65ad427, identifier: 129479
2026-03-12 20:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 494cc595-91f7-5b18-b56b-1b81d65ad427 with identifier: 129479
2026-03-12 20:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 494cc595-91f7-5b18-b56b-1b81d65ad427 with identifier: 129479
2026-03-12 20:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 494cc595-91f7-5b18-b56b-1b81d65ad427 with identifier: 129479 to the API
2026-03-12 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:06:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '494cc595-91f7-5b18-b56b-1b81d65ad427',
'is_damaged': False,
'is_operable': True,
'license_plate': 'EG23CZO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-t-roc-hatchback-2022-15-tsi-evo-life-5dr-dsg-129479',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'T-ROC HATCHBACK (2022)',
'odometer': 13489,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63611,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77840,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82186,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68418,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73337,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67054,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69631,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77382,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84720,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_494cc595-91f7-5b18-b56b-1b81d65ad427/494cc595-91f7-5b18-b56b-1b81d65ad427_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118104,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129479/9.jpeg',
'Width': 800}],
'price': 19800.0,
'price_includes_vat': True,
'registration_date': '2023-08-14',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-ROC HATCHBACK (2022) 1.5 TSI EVO Life 5dr DSG',
'transmission': 'automatic',
'trim': '1.5 TSI EVO Life 5dr DSG',
'vin': 'WVGZZZA1ZRV016980',
'year': 2023}
2026-03-12 20:06:37 [arval.uk] INFO: Saving data for 129479: {'created_time': 1773345997.968913, 'last_price_update_time': 1773345997.968925}
2026-03-12 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121431)
2026-03-12 20:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cfa5b10>
2026-03-12 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/9.jpeg saved to cache
2026-03-12 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f0d0186d-ca06-5436-9c6f-f48ace161702
2026-03-12 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121431)
2026-03-12 20:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2b0610>
2026-03-12 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/8.jpeg saved to cache
2026-03-12 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f0d0186d-ca06-5436-9c6f-f48ace161702
2026-03-12 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127040> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0554ffc-9ee8-5091-943d-c75fb2095b11 with identifier: 127040
2026-03-12 20:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0554ffc-9ee8-5091-943d-c75fb2095b11 with scrape type 1
2026-03-12 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0554ffc-9ee8-5091-943d-c75fb2095b11
2026-03-12 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/0.jpeg not downloaded yet
2026-03-12 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/1.jpeg not downloaded yet
2026-03-12 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/2.jpeg not downloaded yet
2026-03-12 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/3.jpeg not downloaded yet
2026-03-12 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/4.jpeg not downloaded yet
2026-03-12 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/5.jpeg not downloaded yet
2026-03-12 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/6.jpeg not downloaded yet
2026-03-12 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/7.jpeg not downloaded yet
2026-03-12 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/8.jpeg not downloaded yet
2026-03-12 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/9.jpeg not downloaded yet
2026-03-12 20:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121431)
2026-03-12 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a3990>
2026-03-12 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/7.jpeg saved to cache
2026-03-12 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f0d0186d-ca06-5436-9c6f-f48ace161702
2026-03-12 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128781> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1 with identifier: 128781
2026-03-12 20:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1 with scrape type 1
2026-03-12 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1
2026-03-12 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/0.jpeg not downloaded yet
2026-03-12 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/1.jpeg not downloaded yet
2026-03-12 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/2.jpeg not downloaded yet
2026-03-12 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/3.jpeg not downloaded yet
2026-03-12 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/4.jpeg not downloaded yet
2026-03-12 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/5.jpeg not downloaded yet
2026-03-12 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/6.jpeg not downloaded yet
2026-03-12 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/7.jpeg not downloaded yet
2026-03-12 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/8.jpeg not downloaded yet
2026-03-12 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/9.jpeg not downloaded yet
2026-03-12 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126155> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3530764-1b2a-545e-bb2e-a188ffc34970 with identifier: 126155
2026-03-12 20:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3530764-1b2a-545e-bb2e-a188ffc34970 with scrape type 1
2026-03-12 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3530764-1b2a-545e-bb2e-a188ffc34970
2026-03-12 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/0.jpeg not downloaded yet
2026-03-12 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/1.jpeg not downloaded yet
2026-03-12 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121431)
2026-03-12 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/2.jpeg not downloaded yet
2026-03-12 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/3.jpeg not downloaded yet
2026-03-12 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/4.jpeg not downloaded yet
2026-03-12 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/5.jpeg not downloaded yet
2026-03-12 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/6.jpeg not downloaded yet
2026-03-12 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/7.jpeg not downloaded yet
2026-03-12 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/8.jpeg not downloaded yet
2026-03-12 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/9.jpeg not downloaded yet
2026-03-12 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb0f50>
2026-03-12 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/6.jpeg saved to cache
2026-03-12 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f0d0186d-ca06-5436-9c6f-f48ace161702
2026-03-12 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121431)
2026-03-12 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67629610>
2026-03-12 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/5.jpeg saved to cache
2026-03-12 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f0d0186d-ca06-5436-9c6f-f48ace161702
2026-03-12 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121431)
2026-03-12 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762a7d0>
2026-03-12 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/4.jpeg saved to cache
2026-03-12 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0d0186d-ca06-5436-9c6f-f48ace161702
2026-03-12 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121431)
2026-03-12 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660abe10>
2026-03-12 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/2.jpeg saved to cache
2026-03-12 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0d0186d-ca06-5436-9c6f-f48ace161702
2026-03-12 20:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121431)
2026-03-12 20:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67628990>
2026-03-12 20:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/1.jpeg saved to cache
2026-03-12 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f0d0186d-ca06-5436-9c6f-f48ace161702
2026-03-12 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121431)
2026-03-12 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1cb10>
2026-03-12 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/0.jpeg saved to cache
2026-03-12 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0d0186d-ca06-5436-9c6f-f48ace161702
2026-03-12 20:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0d0186d-ca06-5436-9c6f-f48ace161702, skipping ID generation
2026-03-12 20:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0d0186d-ca06-5436-9c6f-f48ace161702 with scrape type 1
2026-03-12 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0d0186d-ca06-5436-9c6f-f48ace161702 sending to next pipeline
2026-03-12 20:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: f0d0186d-ca06-5436-9c6f-f48ace161702, identifier: 121431
2026-03-12 20:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: f0d0186d-ca06-5436-9c6f-f48ace161702 with identifier: 121431
2026-03-12 20:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: f0d0186d-ca06-5436-9c6f-f48ace161702 with identifier: 121431
2026-03-12 20:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: f0d0186d-ca06-5436-9c6f-f48ace161702 with identifier: 121431 to the API
2026-03-12 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:06:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 204,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'f0d0186d-ca06-5436-9c6f-f48ace161702',
'is_damaged': False,
'is_operable': True,
'license_plate': 'VK73UPO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-polo-hatchback-2021-20-tsi-gti-5dr-dsg-121431',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'POLO HATCHBACK (2021)',
'odometer': 30655,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 51,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52776,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48567,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52743,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53082,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52377,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49425,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53034,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50658,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99375,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0d0186d-ca06-5436-9c6f-f48ace161702/f0d0186d-ca06-5436-9c6f-f48ace161702_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50423,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121431/9.jpeg',
'Width': 800}],
'price': 19600.0,
'price_includes_vat': True,
'registration_date': '2023-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen POLO HATCHBACK (2021) 2.0 TSI GTI 5dr DSG',
'transmission': 'automatic',
'trim': '2.0 TSI GTI 5dr DSG',
'vin': 'WVWZZZAWZPU110033',
'year': 2023}
2026-03-12 20:06:49 [arval.uk] INFO: Saving data for 121431: {'created_time': 1773346009.912697, 'last_price_update_time': 1773346009.912706}
2026-03-12 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130276)
2026-03-12 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c12f750>
2026-03-12 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/6.jpeg saved to cache
2026-03-12 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65325aea-8504-58e6-9ec6-2f30ba424c6b
2026-03-12 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130276)
2026-03-12 20:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a8490>
2026-03-12 20:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/5.jpeg saved to cache
2026-03-12 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65325aea-8504-58e6-9ec6-2f30ba424c6b
2026-03-12 20:06:51 [scrapy.extensions.logstats] INFO: Crawled 86 pages (at 6 pages/min), scraped 53 items (at 5 items/min)
2026-03-12 20:06:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130276)
2026-03-12 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67121010>
2026-03-12 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/4.jpeg saved to cache
2026-03-12 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65325aea-8504-58e6-9ec6-2f30ba424c6b
2026-03-12 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130276)
2026-03-12 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67614d50>
2026-03-12 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/3.jpeg saved to cache
2026-03-12 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65325aea-8504-58e6-9ec6-2f30ba424c6b
2026-03-12 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130276)
2026-03-12 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712ad10>
2026-03-12 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/2.jpeg saved to cache
2026-03-12 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65325aea-8504-58e6-9ec6-2f30ba424c6b
2026-03-12 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130276)
2026-03-12 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb7d10>
2026-03-12 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/1.jpeg saved to cache
2026-03-12 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65325aea-8504-58e6-9ec6-2f30ba424c6b
2026-03-12 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130276)
2026-03-12 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67680510>
2026-03-12 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/0.jpeg saved to cache
2026-03-12 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65325aea-8504-58e6-9ec6-2f30ba424c6b
2026-03-12 20:06:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65325aea-8504-58e6-9ec6-2f30ba424c6b, skipping ID generation
2026-03-12 20:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65325aea-8504-58e6-9ec6-2f30ba424c6b with scrape type 1
2026-03-12 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65325aea-8504-58e6-9ec6-2f30ba424c6b sending to next pipeline
2026-03-12 20:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 65325aea-8504-58e6-9ec6-2f30ba424c6b, identifier: 130276
2026-03-12 20:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 65325aea-8504-58e6-9ec6-2f30ba424c6b with identifier: 130276
2026-03-12 20:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 65325aea-8504-58e6-9ec6-2f30ba424c6b with identifier: 130276
2026-03-12 20:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 65325aea-8504-58e6-9ec6-2f30ba424c6b with identifier: 130276 to the API
2026-03-12 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:06:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '65325aea-8504-58e6-9ec6-2f30ba424c6b',
'is_damaged': False,
'is_operable': True,
'license_plate': 'HJ22KVA',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-a3-saloon-2020-35-tfsi-s-line-4dr-s-tronic-130276',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'A3 SALOON (2020)',
'odometer': 44115,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79896,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75180,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84645,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108619,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82970,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66116,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80351,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110897,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65587,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65325aea-8504-58e6-9ec6-2f30ba424c6b/65325aea-8504-58e6-9ec6-2f30ba424c6b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105309,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130276/9.jpeg',
'Width': 800}],
'price': 19900.0,
'price_includes_vat': True,
'registration_date': '2022-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 SALOON (2020) 35 TFSI S line 4dr S Tronic',
'transmission': 'automatic',
'trim': '35 TFSI S line 4dr S Tronic',
'vin': 'WAUZZZGY5NA057886',
'year': 2022}
2026-03-12 20:06:57 [arval.uk] INFO: Saving data for 130276: {'created_time': 1773346017.237312, 'last_price_update_time': 1773346017.237322}
2026-03-12 20:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127040)
2026-03-12 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a8910>
2026-03-12 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/9.jpeg saved to cache
2026-03-12 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0554ffc-9ee8-5091-943d-c75fb2095b11
2026-03-12 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127040)
2026-03-12 20:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67122710>
2026-03-12 20:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:06:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:06:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/8.jpeg saved to cache
2026-03-12 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0554ffc-9ee8-5091-943d-c75fb2095b11
2026-03-12 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128781)
2026-03-12 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2e9d50>
2026-03-12 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/9.jpeg saved to cache
2026-03-12 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1
2026-03-12 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126155)
2026-03-12 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762a7d0>
2026-03-12 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/1.jpeg saved to cache
2026-03-12 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3530764-1b2a-545e-bb2e-a188ffc34970
2026-03-12 20:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126155)
2026-03-12 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b5f50>
2026-03-12 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/9.jpeg saved to cache
2026-03-12 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3530764-1b2a-545e-bb2e-a188ffc34970
2026-03-12 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126155)
2026-03-12 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67663790>
2026-03-12 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/8.jpeg saved to cache
2026-03-12 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3530764-1b2a-545e-bb2e-a188ffc34970
2026-03-12 20:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126155)
2026-03-12 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f34310>
2026-03-12 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/7.jpeg saved to cache
2026-03-12 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3530764-1b2a-545e-bb2e-a188ffc34970
2026-03-12 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126155)
2026-03-12 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67629990>
2026-03-12 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/6.jpeg saved to cache
2026-03-12 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3530764-1b2a-545e-bb2e-a188ffc34970
2026-03-12 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126155)
2026-03-12 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766c290>
2026-03-12 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/5.jpeg saved to cache
2026-03-12 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3530764-1b2a-545e-bb2e-a188ffc34970
2026-03-12 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126155)
2026-03-12 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762a950>
2026-03-12 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/4.jpeg saved to cache
2026-03-12 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3530764-1b2a-545e-bb2e-a188ffc34970
2026-03-12 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126155)
2026-03-12 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16e890>
2026-03-12 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/3.jpeg saved to cache
2026-03-12 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3530764-1b2a-545e-bb2e-a188ffc34970
2026-03-12 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126155)
2026-03-12 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbdebd0>
2026-03-12 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/2.jpeg saved to cache
2026-03-12 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3530764-1b2a-545e-bb2e-a188ffc34970
2026-03-12 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126155)
2026-03-12 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67617a50>
2026-03-12 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/0.jpeg saved to cache
2026-03-12 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3530764-1b2a-545e-bb2e-a188ffc34970
2026-03-12 20:07:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3530764-1b2a-545e-bb2e-a188ffc34970, skipping ID generation
2026-03-12 20:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3530764-1b2a-545e-bb2e-a188ffc34970 with scrape type 1
2026-03-12 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3530764-1b2a-545e-bb2e-a188ffc34970 sending to next pipeline
2026-03-12 20:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: f3530764-1b2a-545e-bb2e-a188ffc34970, identifier: 126155
2026-03-12 20:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: f3530764-1b2a-545e-bb2e-a188ffc34970 with identifier: 126155
2026-03-12 20:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: f3530764-1b2a-545e-bb2e-a188ffc34970 with identifier: 126155
2026-03-12 20:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: f3530764-1b2a-545e-bb2e-a188ffc34970 with identifier: 126155 to the API
2026-03-12 20:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:07:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'engine_horse_power': 242,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': 'f3530764-1b2a-545e-bb2e-a188ffc34970',
'is_damaged': False,
'is_operable': True,
'license_plate': 'VN72RWX',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-14-tsi-gte-5dr-dsg-126155',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 30711,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46554,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37849,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42787,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42409,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40276,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32395,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42562,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43329,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40576,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3530764-1b2a-545e-bb2e-a188ffc34970/f3530764-1b2a-545e-bb2e-a188ffc34970_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62046,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126155/9.jpeg',
'Width': 800}],
'price': 19300.0,
'price_includes_vat': True,
'registration_date': '2022-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 1.4 TSI GTE 5dr DSG',
'transmission': 'automatic',
'trim': '1.4 TSI GTE 5dr DSG',
'vin': 'WVWZZZCD2PW306818',
'year': 2022}
2026-03-12 20:07:13 [arval.uk] INFO: Saving data for 126155: {'created_time': 1773346033.817355, 'last_price_update_time': 1773346033.817366}
2026-03-12 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128781)
2026-03-12 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5c450>
2026-03-12 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/8.jpeg saved to cache
2026-03-12 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1
2026-03-12 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128781)
2026-03-12 20:07:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677713d0>
2026-03-12 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/7.jpeg saved to cache
2026-03-12 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1
2026-03-12 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128781)
2026-03-12 20:07:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67129190>
2026-03-12 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/6.jpeg saved to cache
2026-03-12 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1
2026-03-12 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129582> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3372b99d-7930-5c73-b865-89cd09bda660 with identifier: 129582
2026-03-12 20:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3372b99d-7930-5c73-b865-89cd09bda660 with scrape type 1
2026-03-12 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3372b99d-7930-5c73-b865-89cd09bda660
2026-03-12 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/0.jpeg not downloaded yet
2026-03-12 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/1.jpeg not downloaded yet
2026-03-12 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/2.jpeg not downloaded yet
2026-03-12 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/3.jpeg not downloaded yet
2026-03-12 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/4.jpeg not downloaded yet
2026-03-12 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/5.jpeg not downloaded yet
2026-03-12 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/6.jpeg not downloaded yet
2026-03-12 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/7.jpeg not downloaded yet
2026-03-12 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/8.jpeg not downloaded yet
2026-03-12 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/9.jpeg not downloaded yet
2026-03-12 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128781)
2026-03-12 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b4e50>
2026-03-12 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/5.jpeg saved to cache
2026-03-12 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1
2026-03-12 20:07:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124002> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9026606a-3eb2-58ad-9d67-40200e85fc85 with identifier: 124002
2026-03-12 20:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9026606a-3eb2-58ad-9d67-40200e85fc85 with scrape type 1
2026-03-12 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9026606a-3eb2-58ad-9d67-40200e85fc85
2026-03-12 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/0.jpeg not downloaded yet
2026-03-12 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/1.jpeg not downloaded yet
2026-03-12 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/2.jpeg not downloaded yet
2026-03-12 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/3.jpeg not downloaded yet
2026-03-12 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/4.jpeg not downloaded yet
2026-03-12 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/5.jpeg not downloaded yet
2026-03-12 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/6.jpeg not downloaded yet
2026-03-12 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/7.jpeg not downloaded yet
2026-03-12 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/8.jpeg not downloaded yet
2026-03-12 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/9.jpeg not downloaded yet
2026-03-12 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128781)
2026-03-12 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67123c90>
2026-03-12 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/4.jpeg saved to cache
2026-03-12 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1
2026-03-12 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128781)
2026-03-12 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126620> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c114f10>
2026-03-12 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/3.jpeg saved to cache
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1
2026-03-12 20:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4473b275-bede-5fc8-9c65-7164d3d7c5f0 with identifier: 126620
2026-03-12 20:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0 with scrape type 1
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/0.jpeg not downloaded yet
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/1.jpeg not downloaded yet
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/2.jpeg not downloaded yet
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/3.jpeg not downloaded yet
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/4.jpeg not downloaded yet
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/5.jpeg not downloaded yet
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/6.jpeg not downloaded yet
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/7.jpeg not downloaded yet
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/8.jpeg not downloaded yet
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/9.jpeg not downloaded yet
2026-03-12 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128781)
2026-03-12 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67615f10>
2026-03-12 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/2.jpeg saved to cache
2026-03-12 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1
2026-03-12 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128781)
2026-03-12 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f8250>
2026-03-12 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/1.jpeg saved to cache
2026-03-12 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1
2026-03-12 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128781)
2026-03-12 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b9f10>
2026-03-12 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/0.jpeg saved to cache
2026-03-12 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1
2026-03-12 20:07:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1, skipping ID generation
2026-03-12 20:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1 with scrape type 1
2026-03-12 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1 sending to next pipeline
2026-03-12 20:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1, identifier: 128781
2026-03-12 20:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1 with identifier: 128781
2026-03-12 20:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1 with identifier: 128781
2026-03-12 20:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1 with identifier: 128781 to the API
2026-03-12 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:07:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 208,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': '6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1',
'is_damaged': False,
'is_operable': True,
'license_plate': 'GJ71EUL',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volvo-xc40-estate-2018-15-t4-recharge-phev-r-design-5dr-auto-128781',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volvo',
'model': 'XC40 ESTATE (2018)',
'odometer': 49141,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77582,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67395,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88616,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75360,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84381,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67753,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82073,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84588,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87909,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1/6e4fc4be-3f1d-5e50-a1eb-edcdaad1fcb1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58293,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128781/9.jpeg',
'Width': 800}],
'price': 19300.0,
'price_includes_vat': True,
'registration_date': '2021-10-11',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 ESTATE (2018) 1.5 T4 Recharge PHEV R DESIGN 5dr Auto',
'transmission': 'automatic',
'trim': '1.5 T4 Recharge PHEV R DESIGN 5dr Auto',
'vin': 'YV1XZBWVFN2677491',
'year': 2021}
2026-03-12 20:07:23 [arval.uk] INFO: Saving data for 128781: {'created_time': 1773346043.931709, 'last_price_update_time': 1773346043.931721}
2026-03-12 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127040)
2026-03-12 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbddf90>
2026-03-12 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/7.jpeg saved to cache
2026-03-12 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0554ffc-9ee8-5091-943d-c75fb2095b11
2026-03-12 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127040)
2026-03-12 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763ad50>
2026-03-12 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/6.jpeg saved to cache
2026-03-12 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0554ffc-9ee8-5091-943d-c75fb2095b11
2026-03-12 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127040)
2026-03-12 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c17a650>
2026-03-12 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/5.jpeg saved to cache
2026-03-12 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0554ffc-9ee8-5091-943d-c75fb2095b11
2026-03-12 20:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127040)
2026-03-12 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676617d0>
2026-03-12 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/4.jpeg saved to cache
2026-03-12 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0554ffc-9ee8-5091-943d-c75fb2095b11
2026-03-12 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127040)
2026-03-12 20:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f36810>
2026-03-12 20:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/3.jpeg saved to cache
2026-03-12 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0554ffc-9ee8-5091-943d-c75fb2095b11
2026-03-12 20:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127040)
2026-03-12 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a66d0>
2026-03-12 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/2.jpeg saved to cache
2026-03-12 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0554ffc-9ee8-5091-943d-c75fb2095b11
2026-03-12 20:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127040)
2026-03-12 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a88d0>
2026-03-12 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/1.jpeg saved to cache
2026-03-12 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0554ffc-9ee8-5091-943d-c75fb2095b11
2026-03-12 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127040)
2026-03-12 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c12fd10>
2026-03-12 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/0.jpeg saved to cache
2026-03-12 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0554ffc-9ee8-5091-943d-c75fb2095b11
2026-03-12 20:07:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0554ffc-9ee8-5091-943d-c75fb2095b11, skipping ID generation
2026-03-12 20:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0554ffc-9ee8-5091-943d-c75fb2095b11 with scrape type 1
2026-03-12 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0554ffc-9ee8-5091-943d-c75fb2095b11 sending to next pipeline
2026-03-12 20:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: a0554ffc-9ee8-5091-943d-c75fb2095b11, identifier: 127040
2026-03-12 20:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: a0554ffc-9ee8-5091-943d-c75fb2095b11 with identifier: 127040
2026-03-12 20:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: a0554ffc-9ee8-5091-943d-c75fb2095b11 with identifier: 127040
2026-03-12 20:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: a0554ffc-9ee8-5091-943d-c75fb2095b11 with identifier: 127040 to the API
2026-03-12 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:07:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'engine_horse_power': 137,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'a0554ffc-9ee8-5091-943d-c75fb2095b11',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BC74EGV',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/nissan-qashqai-hatchback-2024-13-dig-t-mh-n-connecta-glass-roof-5dr-127040',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Nissan',
'model': 'QASHQAI HATCHBACK (2024)',
'odometer': 12923,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99811,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83164,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91421,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107958,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101059,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79682,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96876,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103390,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69518,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0554ffc-9ee8-5091-943d-c75fb2095b11/a0554ffc-9ee8-5091-943d-c75fb2095b11_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115542,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127040/9.jpeg',
'Width': 800}],
'price': 19400.0,
'price_includes_vat': True,
'registration_date': '2025-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan QASHQAI HATCHBACK (2024) 1.3 DiG-T MH N-Connecta [Glass '
'Roof] 5dr',
'transmission': 'manual',
'trim': '1.3 DiG-T MH N-Connecta [Glass Roof] 5dr',
'vin': 'SJNTAAJ12U2096441',
'year': 2025}
2026-03-12 20:07:33 [arval.uk] INFO: Saving data for 127040: {'created_time': 1773346053.817083, 'last_price_update_time': 1773346053.817093}
2026-03-12 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129582)
2026-03-12 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66068150>
2026-03-12 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/9.jpeg saved to cache
2026-03-12 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3372b99d-7930-5c73-b865-89cd09bda660
2026-03-12 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129582)
2026-03-12 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f36cd0>
2026-03-12 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/8.jpeg saved to cache
2026-03-12 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3372b99d-7930-5c73-b865-89cd09bda660
2026-03-12 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124002)
2026-03-12 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67766dd0>
2026-03-12 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/9.jpeg saved to cache
2026-03-12 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9026606a-3eb2-58ad-9d67-40200e85fc85
2026-03-12 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124002)
2026-03-12 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c178f90>
2026-03-12 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/8.jpeg saved to cache
2026-03-12 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9026606a-3eb2-58ad-9d67-40200e85fc85
2026-03-12 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124002)
2026-03-12 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607b850>
2026-03-12 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/7.jpeg saved to cache
2026-03-12 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9026606a-3eb2-58ad-9d67-40200e85fc85
2026-03-12 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126620)
2026-03-12 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7a9d0>
2026-03-12 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/9.jpeg saved to cache
2026-03-12 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0
2026-03-12 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126620)
2026-03-12 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66079ad0>
2026-03-12 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/8.jpeg saved to cache
2026-03-12 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0
2026-03-12 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126620)
2026-03-12 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67662610>
2026-03-12 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/7.jpeg saved to cache
2026-03-12 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0
2026-03-12 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126620)
2026-03-12 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660bb650>
2026-03-12 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/6.jpeg saved to cache
2026-03-12 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0
2026-03-12 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126620)
2026-03-12 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5dad0>
2026-03-12 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/5.jpeg saved to cache
2026-03-12 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0
2026-03-12 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126620)
2026-03-12 20:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717afd0>
2026-03-12 20:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/4.jpeg saved to cache
2026-03-12 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0
2026-03-12 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126620)
2026-03-12 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a9c50>
2026-03-12 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/3.jpeg saved to cache
2026-03-12 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0
2026-03-12 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126620)
2026-03-12 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6773b7d0>
2026-03-12 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/2.jpeg saved to cache
2026-03-12 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0
2026-03-12 20:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126620)
2026-03-12 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66069610>
2026-03-12 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/1.jpeg saved to cache
2026-03-12 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0
2026-03-12 20:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126620)
2026-03-12 20:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660bac90>
2026-03-12 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/0.jpeg saved to cache
2026-03-12 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0
2026-03-12 20:07:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4473b275-bede-5fc8-9c65-7164d3d7c5f0, skipping ID generation
2026-03-12 20:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0 with scrape type 1
2026-03-12 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4473b275-bede-5fc8-9c65-7164d3d7c5f0 sending to next pipeline
2026-03-12 20:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 4473b275-bede-5fc8-9c65-7164d3d7c5f0, identifier: 126620
2026-03-12 20:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 4473b275-bede-5fc8-9c65-7164d3d7c5f0 with identifier: 126620
2026-03-12 20:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 4473b275-bede-5fc8-9c65-7164d3d7c5f0 with identifier: 126620
2026-03-12 20:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 4473b275-bede-5fc8-9c65-7164d3d7c5f0 with identifier: 126620 to the API
2026-03-12 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:07:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '4473b275-bede-5fc8-9c65-7164d3d7c5f0',
'is_damaged': False,
'is_operable': True,
'license_plate': 'AK72VHG',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-15-tsi-150-r-line-5dr-126620',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 28403,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91275,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83212,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89148,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91878,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74790,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83872,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98720,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96786,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96695,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4473b275-bede-5fc8-9c65-7164d3d7c5f0/4473b275-bede-5fc8-9c65-7164d3d7c5f0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76866,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126620/9.jpeg',
'Width': 800}],
'price': 19000.0,
'price_includes_vat': True,
'registration_date': '2022-12-05',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 1.5 TSI 150 R-Line 5dr',
'transmission': 'manual',
'trim': '1.5 TSI 150 R-Line 5dr',
'vin': 'WVWZZZCD0PW016528',
'year': 2022}
2026-03-12 20:07:51 [arval.uk] INFO: Saving data for 126620: {'created_time': 1773346071.620631, 'last_price_update_time': 1773346071.620643}
2026-03-12 20:07:51 [scrapy.extensions.logstats] INFO: Crawled 89 pages (at 3 pages/min), scraped 58 items (at 5 items/min)
2026-03-12 20:07:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124002)
2026-03-12 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604cdd0>
2026-03-12 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/6.jpeg saved to cache
2026-03-12 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9026606a-3eb2-58ad-9d67-40200e85fc85
2026-03-12 20:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124002)
2026-03-12 20:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129596> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ba150>
2026-03-12 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/5.jpeg saved to cache
2026-03-12 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9026606a-3eb2-58ad-9d67-40200e85fc85
2026-03-12 20:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d01c811c-38f4-53e5-91d1-c7fe5d4981a4 with identifier: 129596
2026-03-12 20:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4 with scrape type 1
2026-03-12 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4
2026-03-12 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/0.jpeg not downloaded yet
2026-03-12 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/1.jpeg not downloaded yet
2026-03-12 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/2.jpeg not downloaded yet
2026-03-12 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/3.jpeg not downloaded yet
2026-03-12 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/4.jpeg not downloaded yet
2026-03-12 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/5.jpeg not downloaded yet
2026-03-12 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/6.jpeg not downloaded yet
2026-03-12 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/7.jpeg not downloaded yet
2026-03-12 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/8.jpeg not downloaded yet
2026-03-12 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/9.jpeg not downloaded yet
2026-03-12 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124948> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23385c50-560b-5c56-8501-7539abf889a1 with identifier: 124948
2026-03-12 20:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23385c50-560b-5c56-8501-7539abf889a1 with scrape type 1
2026-03-12 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23385c50-560b-5c56-8501-7539abf889a1
2026-03-12 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/0.jpeg not downloaded yet
2026-03-12 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/1.jpeg not downloaded yet
2026-03-12 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/2.jpeg not downloaded yet
2026-03-12 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/3.jpeg not downloaded yet
2026-03-12 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/4.jpeg not downloaded yet
2026-03-12 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/5.jpeg not downloaded yet
2026-03-12 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/6.jpeg not downloaded yet
2026-03-12 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/7.jpeg not downloaded yet
2026-03-12 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/8.jpeg not downloaded yet
2026-03-12 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/9.jpeg not downloaded yet
2026-03-12 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124002)
2026-03-12 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f79d10>
2026-03-12 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/4.jpeg saved to cache
2026-03-12 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9026606a-3eb2-58ad-9d67-40200e85fc85
2026-03-12 20:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126502> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57297d56-4566-5b6e-a4a1-3c2e2b44c982 with identifier: 126502
2026-03-12 20:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982 with scrape type 1
2026-03-12 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982
2026-03-12 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/0.jpeg not downloaded yet
2026-03-12 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/1.jpeg not downloaded yet
2026-03-12 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/2.jpeg not downloaded yet
2026-03-12 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/3.jpeg not downloaded yet
2026-03-12 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/4.jpeg not downloaded yet
2026-03-12 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/5.jpeg not downloaded yet
2026-03-12 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/6.jpeg not downloaded yet
2026-03-12 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/7.jpeg not downloaded yet
2026-03-12 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/8.jpeg not downloaded yet
2026-03-12 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/9.jpeg not downloaded yet
2026-03-12 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124002)
2026-03-12 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ba850>
2026-03-12 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/3.jpeg saved to cache
2026-03-12 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9026606a-3eb2-58ad-9d67-40200e85fc85
2026-03-12 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126152> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35c95ffe-0689-5c9b-84bf-fa0505aca403 with identifier: 126152
2026-03-12 20:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35c95ffe-0689-5c9b-84bf-fa0505aca403 with scrape type 1
2026-03-12 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35c95ffe-0689-5c9b-84bf-fa0505aca403
2026-03-12 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/0.jpeg not downloaded yet
2026-03-12 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/1.jpeg not downloaded yet
2026-03-12 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/2.jpeg not downloaded yet
2026-03-12 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/3.jpeg not downloaded yet
2026-03-12 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/4.jpeg not downloaded yet
2026-03-12 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/5.jpeg not downloaded yet
2026-03-12 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/6.jpeg not downloaded yet
2026-03-12 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/7.jpeg not downloaded yet
2026-03-12 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/8.jpeg not downloaded yet
2026-03-12 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/9.jpeg not downloaded yet
2026-03-12 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124002)
2026-03-12 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677389d0>
2026-03-12 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/2.jpeg saved to cache
2026-03-12 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9026606a-3eb2-58ad-9d67-40200e85fc85
2026-03-12 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124002)
2026-03-12 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a5350>
2026-03-12 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:07:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:07:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/1.jpeg saved to cache
2026-03-12 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9026606a-3eb2-58ad-9d67-40200e85fc85
2026-03-12 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124002)
2026-03-12 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ba690>
2026-03-12 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/0.jpeg saved to cache
2026-03-12 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9026606a-3eb2-58ad-9d67-40200e85fc85
2026-03-12 20:08:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9026606a-3eb2-58ad-9d67-40200e85fc85, skipping ID generation
2026-03-12 20:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9026606a-3eb2-58ad-9d67-40200e85fc85 with scrape type 1
2026-03-12 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9026606a-3eb2-58ad-9d67-40200e85fc85 sending to next pipeline
2026-03-12 20:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 9026606a-3eb2-58ad-9d67-40200e85fc85, identifier: 124002
2026-03-12 20:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 9026606a-3eb2-58ad-9d67-40200e85fc85 with identifier: 124002
2026-03-12 20:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 9026606a-3eb2-58ad-9d67-40200e85fc85 with identifier: 124002
2026-03-12 20:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 9026606a-3eb2-58ad-9d67-40200e85fc85 with identifier: 124002 to the API
2026-03-12 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:08:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '9026606a-3eb2-58ad-9d67-40200e85fc85',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BJ71YME',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-tucson-estate-2020-16-tgdi-ultimate-5dr-2wd-124002',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Hyundai',
'model': 'TUCSON ESTATE (2020)',
'odometer': 26601,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61420,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60644,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59262,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49500,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50722,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172659,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60089,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52439,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79691,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9026606a-3eb2-58ad-9d67-40200e85fc85/9026606a-3eb2-58ad-9d67-40200e85fc85_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81526,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124002/9.jpeg',
'Width': 1280}],
'price': 19000.0,
'price_includes_vat': True,
'registration_date': '2021-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai TUCSON ESTATE (2020) 1.6 TGDi Ultimate 5dr 2WD',
'transmission': 'manual',
'trim': '1.6 TGDi Ultimate 5dr 2WD',
'vin': 'TMAJE81BLMJ122109',
'year': 2021}
2026-03-12 20:08:00 [arval.uk] INFO: Saving data for 124002: {'created_time': 1773346080.759288, 'last_price_update_time': 1773346080.759301}
2026-03-12 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129582)
2026-03-12 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5c410>
2026-03-12 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/7.jpeg saved to cache
2026-03-12 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3372b99d-7930-5c73-b865-89cd09bda660
2026-03-12 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129582)
2026-03-12 20:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778db10>
2026-03-12 20:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/6.jpeg saved to cache
2026-03-12 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3372b99d-7930-5c73-b865-89cd09bda660
2026-03-12 20:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129582)
2026-03-12 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2b3c90>
2026-03-12 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/5.jpeg saved to cache
2026-03-12 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3372b99d-7930-5c73-b865-89cd09bda660
2026-03-12 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129582)
2026-03-12 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbf5790>
2026-03-12 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/4.jpeg saved to cache
2026-03-12 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3372b99d-7930-5c73-b865-89cd09bda660
2026-03-12 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129582)
2026-03-12 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbeeb90>
2026-03-12 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/3.jpeg saved to cache
2026-03-12 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3372b99d-7930-5c73-b865-89cd09bda660
2026-03-12 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129582)
2026-03-12 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbf5a90>
2026-03-12 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/2.jpeg saved to cache
2026-03-12 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3372b99d-7930-5c73-b865-89cd09bda660
2026-03-12 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129582)
2026-03-12 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2e9590>
2026-03-12 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/1.jpeg saved to cache
2026-03-12 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3372b99d-7930-5c73-b865-89cd09bda660
2026-03-12 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129582)
2026-03-12 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c117a50>
2026-03-12 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/0.jpeg saved to cache
2026-03-12 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3372b99d-7930-5c73-b865-89cd09bda660
2026-03-12 20:08:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3372b99d-7930-5c73-b865-89cd09bda660, skipping ID generation
2026-03-12 20:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3372b99d-7930-5c73-b865-89cd09bda660 with scrape type 1
2026-03-12 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3372b99d-7930-5c73-b865-89cd09bda660 sending to next pipeline
2026-03-12 20:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 3372b99d-7930-5c73-b865-89cd09bda660, identifier: 129582
2026-03-12 20:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 3372b99d-7930-5c73-b865-89cd09bda660 with identifier: 129582
2026-03-12 20:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 3372b99d-7930-5c73-b865-89cd09bda660 with identifier: 129582
2026-03-12 20:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 3372b99d-7930-5c73-b865-89cd09bda660 with identifier: 129582 to the API
2026-03-12 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:08:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'engine_horse_power': 201,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': '3372b99d-7930-5c73-b865-89cd09bda660',
'is_damaged': False,
'is_operable': True,
'license_plate': 'KM72BFL',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-a3-sportback-2020-40-tfsi-e-sport-5dr-s-tronic-comfortsound-129582',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'A3 SPORTBACK (2020)',
'odometer': 17319,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83500,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82061,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103491,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97088,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94574,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82253,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97109,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87955,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63085,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3372b99d-7930-5c73-b865-89cd09bda660/3372b99d-7930-5c73-b865-89cd09bda660_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99099,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129582/9.jpeg',
'Width': 800}],
'price': 19200.0,
'price_includes_vat': True,
'registration_date': '2022-10-19',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 SPORTBACK (2020) 40 TFSI e Sport 5dr S Tronic '
'[Comfort+Sound]',
'transmission': 'automatic',
'trim': '40 TFSI e Sport 5dr S Tronic [Comfort+Sound]',
'vin': 'WAUZZZGY3PA029068',
'year': 2022}
2026-03-12 20:08:10 [arval.uk] INFO: Saving data for 129582: {'created_time': 1773346090.750823, 'last_price_update_time': 1773346090.750833}
2026-03-12 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129596)
2026-03-12 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f793d0>
2026-03-12 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/9.jpeg saved to cache
2026-03-12 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4
2026-03-12 20:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124948)
2026-03-12 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66068fd0>
2026-03-12 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/9.jpeg saved to cache
2026-03-12 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23385c50-560b-5c56-8501-7539abf889a1
2026-03-12 20:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124948)
2026-03-12 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712ee50>
2026-03-12 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/8.jpeg saved to cache
2026-03-12 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23385c50-560b-5c56-8501-7539abf889a1
2026-03-12 20:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126502)
2026-03-12 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6d0c36d0>
2026-03-12 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/9.jpeg saved to cache
2026-03-12 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982
2026-03-12 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126502)
2026-03-12 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763aad0>
2026-03-12 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/8.jpeg saved to cache
2026-03-12 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982
2026-03-12 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126152)
2026-03-12 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2e9110>
2026-03-12 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/9.jpeg saved to cache
2026-03-12 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 35c95ffe-0689-5c9b-84bf-fa0505aca403
2026-03-12 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126152)
2026-03-12 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ba210>
2026-03-12 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/8.jpeg saved to cache
2026-03-12 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 35c95ffe-0689-5c9b-84bf-fa0505aca403
2026-03-12 20:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126152)
2026-03-12 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b5610>
2026-03-12 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/7.jpeg saved to cache
2026-03-12 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35c95ffe-0689-5c9b-84bf-fa0505aca403
2026-03-12 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126152)
2026-03-12 20:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67645410>
2026-03-12 20:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/6.jpeg saved to cache
2026-03-12 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 35c95ffe-0689-5c9b-84bf-fa0505aca403
2026-03-12 20:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126152)
2026-03-12 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2e9990>
2026-03-12 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/5.jpeg saved to cache
2026-03-12 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35c95ffe-0689-5c9b-84bf-fa0505aca403
2026-03-12 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126152)
2026-03-12 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbde510>
2026-03-12 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/4.jpeg saved to cache
2026-03-12 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35c95ffe-0689-5c9b-84bf-fa0505aca403
2026-03-12 20:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126152)
2026-03-12 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b4d90>
2026-03-12 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/3.jpeg saved to cache
2026-03-12 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35c95ffe-0689-5c9b-84bf-fa0505aca403
2026-03-12 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126152)
2026-03-12 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c178750>
2026-03-12 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/2.jpeg saved to cache
2026-03-12 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35c95ffe-0689-5c9b-84bf-fa0505aca403
2026-03-12 20:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126152)
2026-03-12 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1d090>
2026-03-12 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/1.jpeg saved to cache
2026-03-12 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35c95ffe-0689-5c9b-84bf-fa0505aca403
2026-03-12 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126152)
2026-03-12 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660bab10>
2026-03-12 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/0.jpeg saved to cache
2026-03-12 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35c95ffe-0689-5c9b-84bf-fa0505aca403
2026-03-12 20:08:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35c95ffe-0689-5c9b-84bf-fa0505aca403, skipping ID generation
2026-03-12 20:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35c95ffe-0689-5c9b-84bf-fa0505aca403 with scrape type 1
2026-03-12 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35c95ffe-0689-5c9b-84bf-fa0505aca403 sending to next pipeline
2026-03-12 20:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 35c95ffe-0689-5c9b-84bf-fa0505aca403, identifier: 126152
2026-03-12 20:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 35c95ffe-0689-5c9b-84bf-fa0505aca403 with identifier: 126152
2026-03-12 20:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 35c95ffe-0689-5c9b-84bf-fa0505aca403 with identifier: 126152
2026-03-12 20:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 35c95ffe-0689-5c9b-84bf-fa0505aca403 with identifier: 126152 to the API
2026-03-12 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:08:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'engine_horse_power': 120,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': '35c95ffe-0689-5c9b-84bf-fa0505aca403',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YE71TUJ',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/toyota-corolla-touring-sport-2018-18-vvt-i-hybrid-icon-5dr-cvt-126152',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Toyota',
'model': 'COROLLA TOURING SPORT (2018)',
'odometer': 17619,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43179,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36943,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41769,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46895,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42389,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34552,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43024,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44725,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34788,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35c95ffe-0689-5c9b-84bf-fa0505aca403/35c95ffe-0689-5c9b-84bf-fa0505aca403_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89503,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126152/9.jpeg',
'Width': 800}],
'price': 18700.0,
'price_includes_vat': True,
'registration_date': '2022-01-10',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota COROLLA TOURING SPORT (2018) 1.8 VVT-i Hybrid Icon 5dr CVT',
'transmission': 'automatic',
'trim': '1.8 VVT-i Hybrid Icon 5dr CVT',
'vin': 'SB1Z93BE30E279992',
'year': 2022}
2026-03-12 20:08:27 [arval.uk] INFO: Saving data for 126152: {'created_time': 1773346107.971139, 'last_price_update_time': 1773346107.97115}
2026-03-12 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126502)
2026-03-12 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604c590>
2026-03-12 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/7.jpeg saved to cache
2026-03-12 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982
2026-03-12 20:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126502)
2026-03-12 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16cfd0>
2026-03-12 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/6.jpeg saved to cache
2026-03-12 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982
2026-03-12 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126502)
2026-03-12 20:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbed190>
2026-03-12 20:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/5.jpeg saved to cache
2026-03-12 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982
2026-03-12 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126502)
2026-03-12 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16f690>
2026-03-12 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/4.jpeg saved to cache
2026-03-12 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982
2026-03-12 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126502)
2026-03-12 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbdd050>
2026-03-12 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/3.jpeg saved to cache
2026-03-12 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982
2026-03-12 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126502)
2026-03-12 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6773a3d0>
2026-03-12 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/2.jpeg saved to cache
2026-03-12 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982
2026-03-12 20:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126502)
2026-03-12 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66069210>
2026-03-12 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/1.jpeg saved to cache
2026-03-12 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982
2026-03-12 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126502)
2026-03-12 20:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16f710>
2026-03-12 20:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/0.jpeg saved to cache
2026-03-12 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982
2026-03-12 20:08:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57297d56-4566-5b6e-a4a1-3c2e2b44c982, skipping ID generation
2026-03-12 20:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982 with scrape type 1
2026-03-12 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57297d56-4566-5b6e-a4a1-3c2e2b44c982 sending to next pipeline
2026-03-12 20:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 57297d56-4566-5b6e-a4a1-3c2e2b44c982, identifier: 126502
2026-03-12 20:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 57297d56-4566-5b6e-a4a1-3c2e2b44c982 with identifier: 126502
2026-03-12 20:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 57297d56-4566-5b6e-a4a1-3c2e2b44c982 with identifier: 126502
2026-03-12 20:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 57297d56-4566-5b6e-a4a1-3c2e2b44c982 with identifier: 126502 to the API
2026-03-12 20:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:08:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 201,
'expiration_date': None,
'fuel_type': 'Electric',
'id': '57297d56-4566-5b6e-a4a1-3c2e2b44c982',
'is_damaged': False,
'is_operable': True,
'license_plate': 'RF72FTJ',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-q4-e-tron-estate-2021-150kw-40-8277kwh-sport-5dr-auto-cs-126502',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'Q4 E-TRON ESTATE (2021)',
'odometer': 45694,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99604,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93853,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95875,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77259,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102957,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86011,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99081,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79671,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88838,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57297d56-4566-5b6e-a4a1-3c2e2b44c982/57297d56-4566-5b6e-a4a1-3c2e2b44c982_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59061,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126502/9.jpeg',
'Width': 800}],
'price': 18700.0,
'price_includes_vat': True,
'registration_date': '2023-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q4 E-TRON ESTATE (2021) 150kW 40 82.77kWh Sport 5dr Auto [C+S]',
'transmission': 'automatic',
'trim': '150kW 40 82.77kWh Sport 5dr Auto [C+S]',
'vin': 'WAUZZZFZ5PP015745',
'year': 2023}
2026-03-12 20:08:38 [arval.uk] INFO: Saving data for 126502: {'created_time': 1773346118.558221, 'last_price_update_time': 1773346118.558231}
2026-03-12 20:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124948)
2026-03-12 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712c110>
2026-03-12 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/7.jpeg saved to cache
2026-03-12 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23385c50-560b-5c56-8501-7539abf889a1
2026-03-12 20:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124948)
2026-03-12 20:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cff0b50>
2026-03-12 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/6.jpeg saved to cache
2026-03-12 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23385c50-560b-5c56-8501-7539abf889a1
2026-03-12 20:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124948)
2026-03-12 20:08:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766ca50>
2026-03-12 20:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/5.jpeg saved to cache
2026-03-12 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23385c50-560b-5c56-8501-7539abf889a1
2026-03-12 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127200> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3 with identifier: 127200
2026-03-12 20:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3 with scrape type 1
2026-03-12 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3
2026-03-12 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/0.jpeg not downloaded yet
2026-03-12 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/1.jpeg not downloaded yet
2026-03-12 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/2.jpeg not downloaded yet
2026-03-12 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/3.jpeg not downloaded yet
2026-03-12 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/4.jpeg not downloaded yet
2026-03-12 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/5.jpeg not downloaded yet
2026-03-12 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/6.jpeg not downloaded yet
2026-03-12 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/7.jpeg not downloaded yet
2026-03-12 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/8.jpeg not downloaded yet
2026-03-12 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/9.jpeg not downloaded yet
2026-03-12 20:08:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124948)
2026-03-12 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67660a10>
2026-03-12 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/4.jpeg saved to cache
2026-03-12 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23385c50-560b-5c56-8501-7539abf889a1
2026-03-12 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128789> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7a20fbc-a511-5007-ad55-3f6b0f946d8d with identifier: 128789
2026-03-12 20:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d with scrape type 1
2026-03-12 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d
2026-03-12 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/0.jpeg not downloaded yet
2026-03-12 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/1.jpeg not downloaded yet
2026-03-12 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/2.jpeg not downloaded yet
2026-03-12 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/3.jpeg not downloaded yet
2026-03-12 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/4.jpeg not downloaded yet
2026-03-12 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/5.jpeg not downloaded yet
2026-03-12 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/6.jpeg not downloaded yet
2026-03-12 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/7.jpeg not downloaded yet
2026-03-12 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/8.jpeg not downloaded yet
2026-03-12 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/9.jpeg not downloaded yet
2026-03-12 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129488> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29f892ec-b014-552c-a6d9-e17aa9701e24 with identifier: 129488
2026-03-12 20:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29f892ec-b014-552c-a6d9-e17aa9701e24 with scrape type 1
2026-03-12 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29f892ec-b014-552c-a6d9-e17aa9701e24
2026-03-12 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/0.jpeg not downloaded yet
2026-03-12 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/1.jpeg not downloaded yet
2026-03-12 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/2.jpeg not downloaded yet
2026-03-12 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/3.jpeg not downloaded yet
2026-03-12 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124948)
2026-03-12 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/4.jpeg not downloaded yet
2026-03-12 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/5.jpeg not downloaded yet
2026-03-12 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/6.jpeg not downloaded yet
2026-03-12 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/7.jpeg not downloaded yet
2026-03-12 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/8.jpeg not downloaded yet
2026-03-12 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/9.jpeg not downloaded yet
2026-03-12 20:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7aa90>
2026-03-12 20:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/3.jpeg saved to cache
2026-03-12 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23385c50-560b-5c56-8501-7539abf889a1
2026-03-12 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124948)
2026-03-12 20:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aad10>
2026-03-12 20:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/2.jpeg saved to cache
2026-03-12 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23385c50-560b-5c56-8501-7539abf889a1
2026-03-12 20:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124948)
2026-03-12 20:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbf5a50>
2026-03-12 20:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/1.jpeg saved to cache
2026-03-12 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23385c50-560b-5c56-8501-7539abf889a1
2026-03-12 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124948)
2026-03-12 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a9650>
2026-03-12 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/0.jpeg saved to cache
2026-03-12 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23385c50-560b-5c56-8501-7539abf889a1
2026-03-12 20:08:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23385c50-560b-5c56-8501-7539abf889a1, skipping ID generation
2026-03-12 20:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23385c50-560b-5c56-8501-7539abf889a1 with scrape type 1
2026-03-12 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23385c50-560b-5c56-8501-7539abf889a1 sending to next pipeline
2026-03-12 20:08:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 23385c50-560b-5c56-8501-7539abf889a1, identifier: 124948
2026-03-12 20:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 23385c50-560b-5c56-8501-7539abf889a1 with identifier: 124948
2026-03-12 20:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 23385c50-560b-5c56-8501-7539abf889a1 with identifier: 124948
2026-03-12 20:08:48 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 23385c50-560b-5c56-8501-7539abf889a1 with identifier: 124948 to the API
2026-03-12 20:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:08:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:08:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 135,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '23385c50-560b-5c56-8501-7539abf889a1',
'is_damaged': False,
'is_operable': True,
'license_plate': 'NL22NDO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/bmw-1-series-hatchback-2019-118i-136-m-sport-5dr-step-auto-lcp-124948',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'BMW',
'model': '1 SERIES HATCHBACK (2019)',
'odometer': 31457,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44074,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43125,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43407,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39056,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42534,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43314,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44688,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43130,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94342,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23385c50-560b-5c56-8501-7539abf889a1/23385c50-560b-5c56-8501-7539abf889a1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48001,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124948/9.jpeg',
'Width': 800}],
'price': 18800.0,
'price_includes_vat': True,
'registration_date': '2022-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1 SERIES HATCHBACK (2019) 118i [136] M Sport 5dr Step Auto '
'[LCP]',
'transmission': 'automatic',
'trim': '118i [136] M Sport 5dr Step Auto [LCP]',
'vin': 'WBA7K320707L01277',
'year': 2022}
2026-03-12 20:08:48 [arval.uk] INFO: Saving data for 124948: {'created_time': 1773346128.410032, 'last_price_update_time': 1773346128.410041}
2026-03-12 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129596)
2026-03-12 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67633010>
2026-03-12 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/8.jpeg saved to cache
2026-03-12 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4
2026-03-12 20:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129596)
2026-03-12 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18ddd0>
2026-03-12 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/7.jpeg saved to cache
2026-03-12 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4
2026-03-12 20:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129596)
2026-03-12 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717af10>
2026-03-12 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/6.jpeg saved to cache
2026-03-12 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4
2026-03-12 20:08:51 [scrapy.extensions.logstats] INFO: Crawled 96 pages (at 7 pages/min), scraped 63 items (at 5 items/min)
2026-03-12 20:08:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129596)
2026-03-12 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a57d0>
2026-03-12 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/5.jpeg saved to cache
2026-03-12 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4
2026-03-12 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129596)
2026-03-12 20:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67753890>
2026-03-12 20:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/4.jpeg saved to cache
2026-03-12 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4
2026-03-12 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129596)
2026-03-12 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67630e10>
2026-03-12 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/3.jpeg saved to cache
2026-03-12 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4
2026-03-12 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129596)
2026-03-12 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b8b90>
2026-03-12 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/2.jpeg saved to cache
2026-03-12 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4
2026-03-12 20:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129596)
2026-03-12 20:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67128c50>
2026-03-12 20:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/1.jpeg saved to cache
2026-03-12 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4
2026-03-12 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129596)
2026-03-12 20:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c117550>
2026-03-12 20:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:08:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:08:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/0.jpeg saved to cache
2026-03-12 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4
2026-03-12 20:08:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d01c811c-38f4-53e5-91d1-c7fe5d4981a4, skipping ID generation
2026-03-12 20:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4 with scrape type 1
2026-03-12 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d01c811c-38f4-53e5-91d1-c7fe5d4981a4 sending to next pipeline
2026-03-12 20:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: d01c811c-38f4-53e5-91d1-c7fe5d4981a4, identifier: 129596
2026-03-12 20:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: d01c811c-38f4-53e5-91d1-c7fe5d4981a4 with identifier: 129596
2026-03-12 20:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: d01c811c-38f4-53e5-91d1-c7fe5d4981a4 with identifier: 129596
2026-03-12 20:08:59 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: d01c811c-38f4-53e5-91d1-c7fe5d4981a4 with identifier: 129596 to the API
2026-03-12 20:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:08:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 94,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'd01c811c-38f4-53e5-91d1-c7fe5d4981a4',
'is_damaged': False,
'is_operable': True,
'license_plate': 'HF24VDE',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-a1-sportback-2018-25-tfsi-sport-5dr-s-tronic-129596',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'A1 SPORTBACK (2018)',
'odometer': 16008,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90870,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80655,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83233,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98346,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88037,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69483,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81021,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93942,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62498,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d01c811c-38f4-53e5-91d1-c7fe5d4981a4/d01c811c-38f4-53e5-91d1-c7fe5d4981a4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105983,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129596/9.jpeg',
'Width': 800}],
'price': 18800.0,
'price_includes_vat': True,
'registration_date': '2024-02-29',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A1 SPORTBACK (2018) 25 TFSI Sport 5dr S Tronic',
'transmission': 'automatic',
'trim': '25 TFSI Sport 5dr S Tronic',
'vin': 'WAUZZZGB0RR031084',
'year': 2024}
2026-03-12 20:08:59 [arval.uk] INFO: Saving data for 129596: {'created_time': 1773346139.645558, 'last_price_update_time': 1773346139.645569}
2026-03-12 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127200)
2026-03-12 20:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67120f50>
2026-03-12 20:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/9.jpeg saved to cache
2026-03-12 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3
2026-03-12 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127200)
2026-03-12 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67771890>
2026-03-12 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/8.jpeg saved to cache
2026-03-12 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3
2026-03-12 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128789)
2026-03-12 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa750>
2026-03-12 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/9.jpeg saved to cache
2026-03-12 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d
2026-03-12 20:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129488)
2026-03-12 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67120d50>
2026-03-12 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/3.jpeg saved to cache
2026-03-12 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29f892ec-b014-552c-a6d9-e17aa9701e24
2026-03-12 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129488)
2026-03-12 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677539d0>
2026-03-12 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/9.jpeg saved to cache
2026-03-12 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29f892ec-b014-552c-a6d9-e17aa9701e24
2026-03-12 20:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129488)
2026-03-12 20:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6d26dc50>
2026-03-12 20:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/8.jpeg saved to cache
2026-03-12 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29f892ec-b014-552c-a6d9-e17aa9701e24
2026-03-12 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129488)
2026-03-12 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604fed0>
2026-03-12 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/7.jpeg saved to cache
2026-03-12 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29f892ec-b014-552c-a6d9-e17aa9701e24
2026-03-12 20:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129488)
2026-03-12 20:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676316d0>
2026-03-12 20:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/6.jpeg saved to cache
2026-03-12 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29f892ec-b014-552c-a6d9-e17aa9701e24
2026-03-12 20:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129488)
2026-03-12 20:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604de10>
2026-03-12 20:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/5.jpeg saved to cache
2026-03-12 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29f892ec-b014-552c-a6d9-e17aa9701e24
2026-03-12 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129488)
2026-03-12 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f34350>
2026-03-12 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/4.jpeg saved to cache
2026-03-12 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29f892ec-b014-552c-a6d9-e17aa9701e24
2026-03-12 20:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129488)
2026-03-12 20:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4c090>
2026-03-12 20:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/2.jpeg saved to cache
2026-03-12 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29f892ec-b014-552c-a6d9-e17aa9701e24
2026-03-12 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129488)
2026-03-12 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778cad0>
2026-03-12 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/1.jpeg saved to cache
2026-03-12 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29f892ec-b014-552c-a6d9-e17aa9701e24
2026-03-12 20:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129488)
2026-03-12 20:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766fa50>
2026-03-12 20:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/0.jpeg saved to cache
2026-03-12 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29f892ec-b014-552c-a6d9-e17aa9701e24
2026-03-12 20:09:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29f892ec-b014-552c-a6d9-e17aa9701e24, skipping ID generation
2026-03-12 20:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29f892ec-b014-552c-a6d9-e17aa9701e24 with scrape type 1
2026-03-12 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29f892ec-b014-552c-a6d9-e17aa9701e24 sending to next pipeline
2026-03-12 20:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 29f892ec-b014-552c-a6d9-e17aa9701e24, identifier: 129488
2026-03-12 20:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 29f892ec-b014-552c-a6d9-e17aa9701e24 with identifier: 129488
2026-03-12 20:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 29f892ec-b014-552c-a6d9-e17aa9701e24 with identifier: 129488
2026-03-12 20:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 29f892ec-b014-552c-a6d9-e17aa9701e24 with identifier: 129488 to the API
2026-03-12 20:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:09:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '29f892ec-b014-552c-a6d9-e17aa9701e24',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YB72CPV',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/seat-leon-hatchback-2020-15-etsi-150-fr-5dr-dsg-129488',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Seat',
'model': 'LEON HATCHBACK (2020)',
'odometer': 11972,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88605,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81645,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97159,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101717,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101275,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94416,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93431,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73747,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60617,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f892ec-b014-552c-a6d9-e17aa9701e24/29f892ec-b014-552c-a6d9-e17aa9701e24_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88240,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129488/9.jpeg',
'Width': 800}],
'price': 17900.0,
'price_includes_vat': True,
'registration_date': '2023-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'Seat LEON HATCHBACK (2020) 1.5 eTSI 150 FR 5dr DSG',
'transmission': 'automatic',
'trim': '1.5 eTSI 150 FR 5dr DSG',
'vin': 'VSSZZZKL9PR016078',
'year': 2023}
2026-03-12 20:09:16 [arval.uk] INFO: Saving data for 129488: {'created_time': 1773346156.319072, 'last_price_update_time': 1773346156.319083}
2026-03-12 20:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128789)
2026-03-12 20:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4d590>
2026-03-12 20:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/8.jpeg saved to cache
2026-03-12 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d
2026-03-12 20:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128789)
2026-03-12 20:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f671200d0>
2026-03-12 20:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/7.jpeg saved to cache
2026-03-12 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d
2026-03-12 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126506> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 844d2162-a7a1-5589-897d-711981757163 with identifier: 126506
2026-03-12 20:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 844d2162-a7a1-5589-897d-711981757163 with scrape type 1
2026-03-12 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 844d2162-a7a1-5589-897d-711981757163
2026-03-12 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/0.jpeg not downloaded yet
2026-03-12 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/1.jpeg not downloaded yet
2026-03-12 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/2.jpeg not downloaded yet
2026-03-12 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/3.jpeg not downloaded yet
2026-03-12 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/4.jpeg not downloaded yet
2026-03-12 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/5.jpeg not downloaded yet
2026-03-12 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/6.jpeg not downloaded yet
2026-03-12 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/7.jpeg not downloaded yet
2026-03-12 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/8.jpeg not downloaded yet
2026-03-12 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/9.jpeg not downloaded yet
2026-03-12 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128789)
2026-03-12 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6d0c3c90>
2026-03-12 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/6.jpeg saved to cache
2026-03-12 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d
2026-03-12 20:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128789)
2026-03-12 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66052b90>
2026-03-12 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/5.jpeg saved to cache
2026-03-12 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d
2026-03-12 20:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128789)
2026-03-12 20:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712c9d0>
2026-03-12 20:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/4.jpeg saved to cache
2026-03-12 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d
2026-03-12 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128789)
2026-03-12 20:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766eed0>
2026-03-12 20:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/3.jpeg saved to cache
2026-03-12 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d
2026-03-12 20:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128789)
2026-03-12 20:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604c1d0>
2026-03-12 20:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/2.jpeg saved to cache
2026-03-12 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d
2026-03-12 20:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128789)
2026-03-12 20:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4d850>
2026-03-12 20:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/1.jpeg saved to cache
2026-03-12 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d
2026-03-12 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128789)
2026-03-12 20:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67771310>
2026-03-12 20:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/0.jpeg saved to cache
2026-03-12 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d
2026-03-12 20:09:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7a20fbc-a511-5007-ad55-3f6b0f946d8d, skipping ID generation
2026-03-12 20:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d with scrape type 1
2026-03-12 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7a20fbc-a511-5007-ad55-3f6b0f946d8d sending to next pipeline
2026-03-12 20:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: a7a20fbc-a511-5007-ad55-3f6b0f946d8d, identifier: 128789
2026-03-12 20:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: a7a20fbc-a511-5007-ad55-3f6b0f946d8d with identifier: 128789
2026-03-12 20:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: a7a20fbc-a511-5007-ad55-3f6b0f946d8d with identifier: 128789
2026-03-12 20:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: a7a20fbc-a511-5007-ad55-3f6b0f946d8d with identifier: 128789 to the API
2026-03-12 20:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:09:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'engine_horse_power': 120,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': 'a7a20fbc-a511-5007-ad55-3f6b0f946d8d',
'is_damaged': False,
'is_operable': True,
'license_plate': 'FD71XOV',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/toyota-corolla-touring-sport-2018-18-vvt-i-hybrid-icon-tech-5dr-cvt-128789',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Toyota',
'model': 'COROLLA TOURING SPORT (2018)',
'odometer': 34188,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60311,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53639,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58201,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53440,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55336,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48679,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56376,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54845,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41499,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7a20fbc-a511-5007-ad55-3f6b0f946d8d/a7a20fbc-a511-5007-ad55-3f6b0f946d8d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85287,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128789/9.jpeg',
'Width': 800}],
'price': 18200.0,
'price_includes_vat': True,
'registration_date': '2022-02-16',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota COROLLA TOURING SPORT (2018) 1.8 VVT-i Hybrid Icon Tech 5dr '
'CVT',
'transmission': 'automatic',
'trim': '1.8 VVT-i Hybrid Icon Tech 5dr CVT',
'vin': 'SB1Z93BE50E287642',
'year': 2022}
2026-03-12 20:09:27 [arval.uk] INFO: Saving data for 128789: {'created_time': 1773346167.203256, 'last_price_update_time': 1773346167.203266}
2026-03-12 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127200)
2026-03-12 20:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67771e50>
2026-03-12 20:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/7.jpeg saved to cache
2026-03-12 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3
2026-03-12 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127200)
2026-03-12 20:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67750c10>
2026-03-12 20:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/6.jpeg saved to cache
2026-03-12 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3
2026-03-12 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127200)
2026-03-12 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1d9d0>
2026-03-12 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/5.jpeg saved to cache
2026-03-12 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3
2026-03-12 20:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127200)
2026-03-12 20:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f8c10>
2026-03-12 20:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/4.jpeg saved to cache
2026-03-12 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3
2026-03-12 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127200)
2026-03-12 20:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c117b10>
2026-03-12 20:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/3.jpeg saved to cache
2026-03-12 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3
2026-03-12 20:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127200)
2026-03-12 20:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee1750>
2026-03-12 20:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/2.jpeg saved to cache
2026-03-12 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3
2026-03-12 20:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127200)
2026-03-12 20:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717aa50>
2026-03-12 20:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/1.jpeg saved to cache
2026-03-12 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3
2026-03-12 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127200)
2026-03-12 20:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606b1d0>
2026-03-12 20:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/0.jpeg saved to cache
2026-03-12 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3
2026-03-12 20:09:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3, skipping ID generation
2026-03-12 20:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3 with scrape type 1
2026-03-12 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3 sending to next pipeline
2026-03-12 20:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3, identifier: 127200
2026-03-12 20:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3 with identifier: 127200
2026-03-12 20:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3 with identifier: 127200
2026-03-12 20:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 3d7f5e29-3f39-53ab-ba1c-149080e8a2e3 with identifier: 127200 to the API
2026-03-12 20:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:09:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'engine_horse_power': 242,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': '3d7f5e29-3f39-53ab-ba1c-149080e8a2e3',
'is_damaged': False,
'is_operable': True,
'license_plate': 'RJ72ZCA',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-14-tsi-gte-5dr-dsg-127200',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 41580,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79298,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85220,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72375,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89677,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92976,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73237,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62444,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79761,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60333,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3d7f5e29-3f39-53ab-ba1c-149080e8a2e3/3d7f5e29-3f39-53ab-ba1c-149080e8a2e3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102815,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127200/9.jpeg',
'Width': 800}],
'price': 18500.0,
'price_includes_vat': True,
'registration_date': '2022-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 1.4 TSI GTE 5dr DSG',
'transmission': 'automatic',
'trim': '1.4 TSI GTE 5dr DSG',
'vin': 'WVWZZZCD0PW306946',
'year': 2022}
2026-03-12 20:09:36 [arval.uk] INFO: Saving data for 127200: {'created_time': 1773346176.868367, 'last_price_update_time': 1773346176.868376}
2026-03-12 20:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118271)
2026-03-12 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67129d50>
2026-03-12 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/8.jpeg saved to cache
2026-03-12 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29f554a8-753f-5367-a09c-a71edb76efe3
2026-03-12 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126506)
2026-03-12 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717ab10>
2026-03-12 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/9.jpeg saved to cache
2026-03-12 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 844d2162-a7a1-5589-897d-711981757163
2026-03-12 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126506)
2026-03-12 20:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1ef90>
2026-03-12 20:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/8.jpeg saved to cache
2026-03-12 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 844d2162-a7a1-5589-897d-711981757163
2026-03-12 20:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126506)
2026-03-12 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f37950>
2026-03-12 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/7.jpeg saved to cache
2026-03-12 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 844d2162-a7a1-5589-897d-711981757163
2026-03-12 20:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126506)
2026-03-12 20:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1ded0>
2026-03-12 20:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/6.jpeg saved to cache
2026-03-12 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 844d2162-a7a1-5589-897d-711981757163
2026-03-12 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126506)
2026-03-12 20:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa810>
2026-03-12 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/5.jpeg saved to cache
2026-03-12 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 844d2162-a7a1-5589-897d-711981757163
2026-03-12 20:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126506)
2026-03-12 20:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa550>
2026-03-12 20:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/4.jpeg saved to cache
2026-03-12 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 844d2162-a7a1-5589-897d-711981757163
2026-03-12 20:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129371> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ada41b4-7db8-5d55-a787-e1767a0e97a5 with identifier: 129371
2026-03-12 20:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5 with scrape type 1
2026-03-12 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5
2026-03-12 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/0.jpeg not downloaded yet
2026-03-12 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/1.jpeg not downloaded yet
2026-03-12 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/2.jpeg not downloaded yet
2026-03-12 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/3.jpeg not downloaded yet
2026-03-12 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/4.jpeg not downloaded yet
2026-03-12 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/5.jpeg not downloaded yet
2026-03-12 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/6.jpeg not downloaded yet
2026-03-12 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/7.jpeg not downloaded yet
2026-03-12 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/8.jpeg not downloaded yet
2026-03-12 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/9.jpeg not downloaded yet
2026-03-12 20:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126506)
2026-03-12 20:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766f350>
2026-03-12 20:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/3.jpeg saved to cache
2026-03-12 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 844d2162-a7a1-5589-897d-711981757163
2026-03-12 20:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123795> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:09:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e62ddaed-4692-5dc0-b771-9909660d19e6 with identifier: 123795
2026-03-12 20:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e62ddaed-4692-5dc0-b771-9909660d19e6 with scrape type 1
2026-03-12 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e62ddaed-4692-5dc0-b771-9909660d19e6
2026-03-12 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/0.jpeg not downloaded yet
2026-03-12 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/1.jpeg not downloaded yet
2026-03-12 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/2.jpeg not downloaded yet
2026-03-12 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/3.jpeg not downloaded yet
2026-03-12 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/4.jpeg not downloaded yet
2026-03-12 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/5.jpeg not downloaded yet
2026-03-12 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/6.jpeg not downloaded yet
2026-03-12 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/7.jpeg not downloaded yet
2026-03-12 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/8.jpeg not downloaded yet
2026-03-12 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/9.jpeg not downloaded yet
2026-03-12 20:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126506)
2026-03-12 20:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4d510>
2026-03-12 20:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/2.jpeg saved to cache
2026-03-12 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 844d2162-a7a1-5589-897d-711981757163
2026-03-12 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128787> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7be17b82-8512-504a-87ae-4dec86f55947 with identifier: 128787
2026-03-12 20:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be17b82-8512-504a-87ae-4dec86f55947 with scrape type 1
2026-03-12 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7be17b82-8512-504a-87ae-4dec86f55947
2026-03-12 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/0.jpeg not downloaded yet
2026-03-12 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/1.jpeg not downloaded yet
2026-03-12 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/2.jpeg not downloaded yet
2026-03-12 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/3.jpeg not downloaded yet
2026-03-12 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/4.jpeg not downloaded yet
2026-03-12 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/5.jpeg not downloaded yet
2026-03-12 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/6.jpeg not downloaded yet
2026-03-12 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/7.jpeg not downloaded yet
2026-03-12 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/8.jpeg not downloaded yet
2026-03-12 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/9.jpeg not downloaded yet
2026-03-12 20:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126506)
2026-03-12 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67764e90>
2026-03-12 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/1.jpeg saved to cache
2026-03-12 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 844d2162-a7a1-5589-897d-711981757163
2026-03-12 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126506)
2026-03-12 20:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676611d0>
2026-03-12 20:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/0.jpeg saved to cache
2026-03-12 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 844d2162-a7a1-5589-897d-711981757163
2026-03-12 20:09:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 844d2162-a7a1-5589-897d-711981757163, skipping ID generation
2026-03-12 20:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 844d2162-a7a1-5589-897d-711981757163 with scrape type 1
2026-03-12 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 844d2162-a7a1-5589-897d-711981757163 sending to next pipeline
2026-03-12 20:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 844d2162-a7a1-5589-897d-711981757163, identifier: 126506
2026-03-12 20:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 844d2162-a7a1-5589-897d-711981757163 with identifier: 126506
2026-03-12 20:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 844d2162-a7a1-5589-897d-711981757163 with identifier: 126506
2026-03-12 20:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 844d2162-a7a1-5589-897d-711981757163 with identifier: 126506 to the API
2026-03-12 20:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:09:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 201,
'expiration_date': None,
'fuel_type': 'Electric',
'id': '844d2162-a7a1-5589-897d-711981757163',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BK71NNU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/skoda-enyaq-iv-estate-2021-150kw-80-ecosuite-82kwh-5dr-auto-126506',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Skoda',
'model': 'ENYAQ IV ESTATE (2021)',
'odometer': 37860,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85274,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88421,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96333,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76404,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82433,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90958,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86214,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73555,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97724,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_844d2162-a7a1-5589-897d-711981757163/844d2162-a7a1-5589-897d-711981757163_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90951,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126506/9.jpeg',
'Width': 800}],
'price': 17800.0,
'price_includes_vat': True,
'registration_date': '2021-12-02',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda ENYAQ IV ESTATE (2021) 150kW 80 ecoSuite 82kWh 5dr Auto',
'transmission': 'automatic',
'trim': '150kW 80 ecoSuite 82kWh 5dr Auto',
'vin': 'TMBKC7NY1NF018499',
'year': 2021}
2026-03-12 20:09:51 [arval.uk] INFO: Saving data for 126506: {'created_time': 1773346191.137573, 'last_price_update_time': 1773346191.137583}
2026-03-12 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118271)
2026-03-12 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6771b5d0>
2026-03-12 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/7.jpeg saved to cache
2026-03-12 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29f554a8-753f-5367-a09c-a71edb76efe3
2026-03-12 20:09:51 [scrapy.extensions.logstats] INFO: Crawled 100 pages (at 4 pages/min), scraped 68 items (at 5 items/min)
2026-03-12 20:09:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118271)
2026-03-12 20:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4fe90>
2026-03-12 20:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/6.jpeg saved to cache
2026-03-12 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29f554a8-753f-5367-a09c-a71edb76efe3
2026-03-12 20:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118271)
2026-03-12 20:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778dcd0>
2026-03-12 20:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/5.jpeg saved to cache
2026-03-12 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29f554a8-753f-5367-a09c-a71edb76efe3
2026-03-12 20:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118271)
2026-03-12 20:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67638c90>
2026-03-12 20:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/4.jpeg saved to cache
2026-03-12 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29f554a8-753f-5367-a09c-a71edb76efe3
2026-03-12 20:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118271)
2026-03-12 20:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b4650>
2026-03-12 20:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/3.jpeg saved to cache
2026-03-12 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29f554a8-753f-5367-a09c-a71edb76efe3
2026-03-12 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118271)
2026-03-12 20:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa750>
2026-03-12 20:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/2.jpeg saved to cache
2026-03-12 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29f554a8-753f-5367-a09c-a71edb76efe3
2026-03-12 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118271)
2026-03-12 20:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb2190>
2026-03-12 20:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/1.jpeg saved to cache
2026-03-12 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29f554a8-753f-5367-a09c-a71edb76efe3
2026-03-12 20:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118271)
2026-03-12 20:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4db10>
2026-03-12 20:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/0.jpeg saved to cache
2026-03-12 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29f554a8-753f-5367-a09c-a71edb76efe3
2026-03-12 20:10:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29f554a8-753f-5367-a09c-a71edb76efe3, skipping ID generation
2026-03-12 20:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29f554a8-753f-5367-a09c-a71edb76efe3 with scrape type 1
2026-03-12 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29f554a8-753f-5367-a09c-a71edb76efe3 sending to next pipeline
2026-03-12 20:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 29f554a8-753f-5367-a09c-a71edb76efe3, identifier: 118271
2026-03-12 20:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 29f554a8-753f-5367-a09c-a71edb76efe3 with identifier: 118271
2026-03-12 20:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 29f554a8-753f-5367-a09c-a71edb76efe3 with identifier: 118271
2026-03-12 20:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 29f554a8-753f-5367-a09c-a71edb76efe3 with identifier: 118271 to the API
2026-03-12 20:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:10:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 107,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '29f554a8-753f-5367-a09c-a71edb76efe3',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YD72EAW',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/seat-leon-hatchback-2020-10-tsi-evo-se-dynamic-5dr-118271',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Seat',
'model': 'LEON HATCHBACK (2020)',
'odometer': 12520,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66954,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78379,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89055,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71847,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47908,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89213,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77593,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68752,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 12308,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29f554a8-753f-5367-a09c-a71edb76efe3/29f554a8-753f-5367-a09c-a71edb76efe3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43258,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118271/9.jpeg',
'Width': 800}],
'price': 13900.0,
'price_includes_vat': True,
'registration_date': '2022-09-18',
'seats_number': 5,
'seller_name': None,
'title': 'Seat LEON HATCHBACK (2020) 1.0 TSI EVO SE Dynamic 5dr',
'transmission': 'manual',
'trim': '1.0 TSI EVO SE Dynamic 5dr',
'vin': 'VSSZZZKLZNR056875',
'year': 2022}
2026-03-12 20:10:01 [arval.uk] INFO: Saving data for 118271: {'created_time': 1773346201.775556, 'last_price_update_time': 1773346201.775569}
2026-03-12 20:10:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114728)
2026-03-12 20:10:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660793d0>
2026-03-12 20:10:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/1.jpeg saved to cache
2026-03-12 20:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c4a088e-9921-5709-9e94-3706151351d9
2026-03-12 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114728)
2026-03-12 20:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4d550>
2026-03-12 20:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/0.jpeg saved to cache
2026-03-12 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c4a088e-9921-5709-9e94-3706151351d9
2026-03-12 20:10:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c4a088e-9921-5709-9e94-3706151351d9, skipping ID generation
2026-03-12 20:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c4a088e-9921-5709-9e94-3706151351d9 with scrape type 1
2026-03-12 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c4a088e-9921-5709-9e94-3706151351d9 sending to next pipeline
2026-03-12 20:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 3c4a088e-9921-5709-9e94-3706151351d9, identifier: 114728
2026-03-12 20:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 3c4a088e-9921-5709-9e94-3706151351d9 with identifier: 114728
2026-03-12 20:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 3c4a088e-9921-5709-9e94-3706151351d9 with identifier: 114728
2026-03-12 20:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 3c4a088e-9921-5709-9e94-3706151351d9 with identifier: 114728 to the API
2026-03-12 20:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:10:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '3c4a088e-9921-5709-9e94-3706151351d9',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DU71EDX',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ds-ds-3-crossback-hatchback-2019-12-puretech-elegance-5dr-114728',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'DS',
'model': 'DS 3 CROSSBACK HATCHBACK (2019)',
'odometer': 32765,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43928,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48434,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43792,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36052,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42325,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42074,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45288,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38416,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55220,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c4a088e-9921-5709-9e94-3706151351d9/3c4a088e-9921-5709-9e94-3706151351d9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48858,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114728/9.jpeg',
'Width': 800}],
'price': 11100.0,
'price_includes_vat': True,
'registration_date': '2021-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'DS DS 3 CROSSBACK HATCHBACK (2019) 1.2 PureTech Elegance 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech Elegance 5dr',
'vin': 'VR1URHNEKMW079051',
'year': 2021}
2026-03-12 20:10:03 [arval.uk] INFO: Saving data for 114728: {'created_time': 1773346203.847593, 'last_price_update_time': 1773346203.847604}
2026-03-12 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129371)
2026-03-12 20:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604f350>
2026-03-12 20:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/9.jpeg saved to cache
2026-03-12 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5
2026-03-12 20:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129371)
2026-03-12 20:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18cd50>
2026-03-12 20:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/8.jpeg saved to cache
2026-03-12 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5
2026-03-12 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123795)
2026-03-12 20:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6710f590>
2026-03-12 20:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/9.jpeg saved to cache
2026-03-12 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e62ddaed-4692-5dc0-b771-9909660d19e6
2026-03-12 20:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123795)
2026-03-12 20:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18c290>
2026-03-12 20:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/8.jpeg saved to cache
2026-03-12 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e62ddaed-4692-5dc0-b771-9909660d19e6
2026-03-12 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128787)
2026-03-12 20:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66079b50>
2026-03-12 20:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/9.jpeg saved to cache
2026-03-12 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7be17b82-8512-504a-87ae-4dec86f55947
2026-03-12 20:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128787)
2026-03-12 20:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f7938cf90>
2026-03-12 20:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/8.jpeg saved to cache
2026-03-12 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7be17b82-8512-504a-87ae-4dec86f55947
2026-03-12 20:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128787)
2026-03-12 20:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1da10>
2026-03-12 20:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/7.jpeg saved to cache
2026-03-12 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7be17b82-8512-504a-87ae-4dec86f55947
2026-03-12 20:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128787)
2026-03-12 20:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604d4d0>
2026-03-12 20:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/6.jpeg saved to cache
2026-03-12 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7be17b82-8512-504a-87ae-4dec86f55947
2026-03-12 20:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128787)
2026-03-12 20:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66053c90>
2026-03-12 20:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/5.jpeg saved to cache
2026-03-12 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7be17b82-8512-504a-87ae-4dec86f55947
2026-03-12 20:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128787)
2026-03-12 20:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4cfd0>
2026-03-12 20:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/4.jpeg saved to cache
2026-03-12 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7be17b82-8512-504a-87ae-4dec86f55947
2026-03-12 20:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128787)
2026-03-12 20:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb2310>
2026-03-12 20:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/3.jpeg saved to cache
2026-03-12 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7be17b82-8512-504a-87ae-4dec86f55947
2026-03-12 20:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128787)
2026-03-12 20:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0dc490>
2026-03-12 20:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/2.jpeg saved to cache
2026-03-12 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7be17b82-8512-504a-87ae-4dec86f55947
2026-03-12 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128787)
2026-03-12 20:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f7a896490>
2026-03-12 20:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/1.jpeg saved to cache
2026-03-12 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7be17b82-8512-504a-87ae-4dec86f55947
2026-03-12 20:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128787)
2026-03-12 20:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4c310>
2026-03-12 20:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/0.jpeg saved to cache
2026-03-12 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7be17b82-8512-504a-87ae-4dec86f55947
2026-03-12 20:10:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7be17b82-8512-504a-87ae-4dec86f55947, skipping ID generation
2026-03-12 20:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be17b82-8512-504a-87ae-4dec86f55947 with scrape type 1
2026-03-12 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7be17b82-8512-504a-87ae-4dec86f55947 sending to next pipeline
2026-03-12 20:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 7be17b82-8512-504a-87ae-4dec86f55947, identifier: 128787
2026-03-12 20:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 7be17b82-8512-504a-87ae-4dec86f55947 with identifier: 128787
2026-03-12 20:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 7be17b82-8512-504a-87ae-4dec86f55947 with identifier: 128787
2026-03-12 20:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 7be17b82-8512-504a-87ae-4dec86f55947 with identifier: 128787 to the API
2026-03-12 20:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:10:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 128,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '7be17b82-8512-504a-87ae-4dec86f55947',
'is_damaged': False,
'is_operable': True,
'license_plate': 'SH72KVF',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-15-tsi-life-5dr-128787',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 13474,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92281,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79080,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86789,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91563,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88716,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74856,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83777,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86656,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70937,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7be17b82-8512-504a-87ae-4dec86f55947/7be17b82-8512-504a-87ae-4dec86f55947_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97870,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128787/9.jpeg',
'Width': 800}],
'price': 17200.0,
'price_includes_vat': True,
'registration_date': '2023-01-22',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 1.5 TSI Life 5dr',
'transmission': 'manual',
'trim': '1.5 TSI Life 5dr',
'vin': 'WVWZZZCD0PW135891',
'year': 2023}
2026-03-12 20:10:20 [arval.uk] INFO: Saving data for 128787: {'created_time': 1773346220.865409, 'last_price_update_time': 1773346220.865418}
2026-03-12 20:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123795)
2026-03-12 20:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c17bf90>
2026-03-12 20:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/7.jpeg saved to cache
2026-03-12 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e62ddaed-4692-5dc0-b771-9909660d19e6
2026-03-12 20:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123795)
2026-03-12 20:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18cb90>
2026-03-12 20:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/6.jpeg saved to cache
2026-03-12 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e62ddaed-4692-5dc0-b771-9909660d19e6
2026-03-12 20:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128924> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe with identifier: 128924
2026-03-12 20:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe with scrape type 1
2026-03-12 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe
2026-03-12 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/0.jpeg not downloaded yet
2026-03-12 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/1.jpeg not downloaded yet
2026-03-12 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/2.jpeg not downloaded yet
2026-03-12 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/3.jpeg not downloaded yet
2026-03-12 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/4.jpeg not downloaded yet
2026-03-12 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/5.jpeg not downloaded yet
2026-03-12 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/6.jpeg not downloaded yet
2026-03-12 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/7.jpeg not downloaded yet
2026-03-12 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/8.jpeg not downloaded yet
2026-03-12 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/9.jpeg not downloaded yet
2026-03-12 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123795)
2026-03-12 20:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f55090>
2026-03-12 20:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/5.jpeg saved to cache
2026-03-12 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e62ddaed-4692-5dc0-b771-9909660d19e6
2026-03-12 20:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116646> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c152cd8-0c8e-5dac-8343-a338673a0d06 with identifier: 116646
2026-03-12 20:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c152cd8-0c8e-5dac-8343-a338673a0d06 with scrape type 1
2026-03-12 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c152cd8-0c8e-5dac-8343-a338673a0d06
2026-03-12 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/0.jpeg not downloaded yet
2026-03-12 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/1.jpeg not downloaded yet
2026-03-12 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/2.jpeg not downloaded yet
2026-03-12 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/3.jpeg not downloaded yet
2026-03-12 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/4.jpeg not downloaded yet
2026-03-12 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/5.jpeg not downloaded yet
2026-03-12 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/6.jpeg not downloaded yet
2026-03-12 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/7.jpeg not downloaded yet
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/8.jpeg not downloaded yet
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/9.jpeg not downloaded yet
2026-03-12 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124453> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3644209b-09dd-5b84-bcc1-a7fe1973f79d with identifier: 124453
2026-03-12 20:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d with scrape type 1
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/0.jpeg not downloaded yet
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/1.jpeg not downloaded yet
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/2.jpeg not downloaded yet
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/3.jpeg not downloaded yet
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/4.jpeg not downloaded yet
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/5.jpeg not downloaded yet
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/6.jpeg not downloaded yet
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/7.jpeg not downloaded yet
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/8.jpeg not downloaded yet
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/9.jpeg not downloaded yet
2026-03-12 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123795)
2026-03-12 20:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607a8d0>
2026-03-12 20:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/4.jpeg saved to cache
2026-03-12 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e62ddaed-4692-5dc0-b771-9909660d19e6
2026-03-12 20:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123795)
2026-03-12 20:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66078fd0>
2026-03-12 20:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/3.jpeg saved to cache
2026-03-12 20:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e62ddaed-4692-5dc0-b771-9909660d19e6
2026-03-12 20:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123795)
2026-03-12 20:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66053090>
2026-03-12 20:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/2.jpeg saved to cache
2026-03-12 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e62ddaed-4692-5dc0-b771-9909660d19e6
2026-03-12 20:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123795)
2026-03-12 20:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f671213d0>
2026-03-12 20:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/1.jpeg saved to cache
2026-03-12 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e62ddaed-4692-5dc0-b771-9909660d19e6
2026-03-12 20:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123795)
2026-03-12 20:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5c7d0>
2026-03-12 20:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/0.jpeg saved to cache
2026-03-12 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e62ddaed-4692-5dc0-b771-9909660d19e6
2026-03-12 20:10:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e62ddaed-4692-5dc0-b771-9909660d19e6, skipping ID generation
2026-03-12 20:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e62ddaed-4692-5dc0-b771-9909660d19e6 with scrape type 1
2026-03-12 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e62ddaed-4692-5dc0-b771-9909660d19e6 sending to next pipeline
2026-03-12 20:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: e62ddaed-4692-5dc0-b771-9909660d19e6, identifier: 123795
2026-03-12 20:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: e62ddaed-4692-5dc0-b771-9909660d19e6 with identifier: 123795
2026-03-12 20:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: e62ddaed-4692-5dc0-b771-9909660d19e6 with identifier: 123795
2026-03-12 20:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: e62ddaed-4692-5dc0-b771-9909660d19e6 with identifier: 123795 to the API
2026-03-12 20:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:10:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'engine_horse_power': 120,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': 'e62ddaed-4692-5dc0-b771-9909660d19e6',
'is_damaged': False,
'is_operable': True,
'license_plate': 'FE22TWU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/toyota-corolla-touring-sport-2018-18-vvt-i-hybrid-icon-tech-5dr-cvt-123795',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Toyota',
'model': 'COROLLA TOURING SPORT (2018)',
'odometer': 40096,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45324,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40839,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45105,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47261,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45143,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34537,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42922,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44292,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70271,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e62ddaed-4692-5dc0-b771-9909660d19e6/e62ddaed-4692-5dc0-b771-9909660d19e6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40922,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123795/9.jpeg',
'Width': 800}],
'price': 17300.0,
'price_includes_vat': True,
'registration_date': '2022-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota COROLLA TOURING SPORT (2018) 1.8 VVT-i Hybrid Icon Tech 5dr '
'CVT',
'transmission': 'automatic',
'trim': '1.8 VVT-i Hybrid Icon Tech 5dr CVT',
'vin': 'SB1Z93BE80E290891',
'year': 2022}
2026-03-12 20:10:31 [arval.uk] INFO: Saving data for 123795: {'created_time': 1773346231.496868, 'last_price_update_time': 1773346231.496879}
2026-03-12 20:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129371)
2026-03-12 20:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607a710>
2026-03-12 20:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/7.jpeg saved to cache
2026-03-12 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5
2026-03-12 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129371)
2026-03-12 20:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66051310>
2026-03-12 20:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/6.jpeg saved to cache
2026-03-12 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5
2026-03-12 20:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129371)
2026-03-12 20:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee2850>
2026-03-12 20:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/5.jpeg saved to cache
2026-03-12 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5
2026-03-12 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129371)
2026-03-12 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67663dd0>
2026-03-12 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/4.jpeg saved to cache
2026-03-12 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5
2026-03-12 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129371)
2026-03-12 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607a490>
2026-03-12 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/3.jpeg saved to cache
2026-03-12 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5
2026-03-12 20:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129371)
2026-03-12 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc1ea10>
2026-03-12 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/2.jpeg saved to cache
2026-03-12 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5
2026-03-12 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129371)
2026-03-12 20:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f8c90>
2026-03-12 20:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/1.jpeg saved to cache
2026-03-12 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5
2026-03-12 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129371)
2026-03-12 20:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef04d0>
2026-03-12 20:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/0.jpeg saved to cache
2026-03-12 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5
2026-03-12 20:10:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ada41b4-7db8-5d55-a787-e1767a0e97a5, skipping ID generation
2026-03-12 20:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5 with scrape type 1
2026-03-12 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ada41b4-7db8-5d55-a787-e1767a0e97a5 sending to next pipeline
2026-03-12 20:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 3ada41b4-7db8-5d55-a787-e1767a0e97a5, identifier: 129371
2026-03-12 20:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 3ada41b4-7db8-5d55-a787-e1767a0e97a5 with identifier: 129371
2026-03-12 20:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 3ada41b4-7db8-5d55-a787-e1767a0e97a5 with identifier: 129371
2026-03-12 20:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 3ada41b4-7db8-5d55-a787-e1767a0e97a5 with identifier: 129371 to the API
2026-03-12 20:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:10:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'engine_horse_power': 120,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': '3ada41b4-7db8-5d55-a787-e1767a0e97a5',
'is_damaged': False,
'is_operable': True,
'license_plate': 'FE22TWN',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/toyota-corolla-touring-sport-2018-18-vvt-i-hybrid-icon-tech-5dr-cvt-129371',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Toyota',
'model': 'COROLLA TOURING SPORT (2018)',
'odometer': 43183,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59842,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55232,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60948,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54090,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56523,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50068,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57094,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55533,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37410,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ada41b4-7db8-5d55-a787-e1767a0e97a5/3ada41b4-7db8-5d55-a787-e1767a0e97a5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83121,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129371/9.jpeg',
'Width': 800}],
'price': 17600.0,
'price_includes_vat': True,
'registration_date': '2022-03-10',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota COROLLA TOURING SPORT (2018) 1.8 VVT-i Hybrid Icon Tech 5dr '
'CVT',
'transmission': 'automatic',
'trim': '1.8 VVT-i Hybrid Icon Tech 5dr CVT',
'vin': 'SB1Z93BE40E291696',
'year': 2022}
2026-03-12 20:10:40 [arval.uk] INFO: Saving data for 129371: {'created_time': 1773346240.498797, 'last_price_update_time': 1773346240.498807}
2026-03-12 20:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128924)
2026-03-12 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f37610>
2026-03-12 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/9.jpeg saved to cache
2026-03-12 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe
2026-03-12 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128924)
2026-03-12 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607b050>
2026-03-12 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/8.jpeg saved to cache
2026-03-12 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe
2026-03-12 20:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116646)
2026-03-12 20:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f55910>
2026-03-12 20:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/9.jpeg saved to cache
2026-03-12 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c152cd8-0c8e-5dac-8343-a338673a0d06
2026-03-12 20:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124453)
2026-03-12 20:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67138a10>
2026-03-12 20:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/9.jpeg saved to cache
2026-03-12 20:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d
2026-03-12 20:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124453)
2026-03-12 20:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67199bd0>
2026-03-12 20:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/8.jpeg saved to cache
2026-03-12 20:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d
2026-03-12 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124453)
2026-03-12 20:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f37e90>
2026-03-12 20:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/7.jpeg saved to cache
2026-03-12 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d
2026-03-12 20:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124453)
2026-03-12 20:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c1169d0>
2026-03-12 20:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/6.jpeg saved to cache
2026-03-12 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d
2026-03-12 20:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124453)
2026-03-12 20:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb7b10>
2026-03-12 20:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/5.jpeg saved to cache
2026-03-12 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d
2026-03-12 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124453)
2026-03-12 20:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c17a390>
2026-03-12 20:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/4.jpeg saved to cache
2026-03-12 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d
2026-03-12 20:10:51 [scrapy.extensions.logstats] INFO: Crawled 103 pages (at 3 pages/min), scraped 73 items (at 5 items/min)
2026-03-12 20:10:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124453)
2026-03-12 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cfb0150>
2026-03-12 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/3.jpeg saved to cache
2026-03-12 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d
2026-03-12 20:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124453)
2026-03-12 20:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c146950>
2026-03-12 20:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/2.jpeg saved to cache
2026-03-12 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d
2026-03-12 20:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124453)
2026-03-12 20:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677b99d0>
2026-03-12 20:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/1.jpeg saved to cache
2026-03-12 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d
2026-03-12 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124453)
2026-03-12 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67639090>
2026-03-12 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/0.jpeg saved to cache
2026-03-12 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d
2026-03-12 20:10:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3644209b-09dd-5b84-bcc1-a7fe1973f79d, skipping ID generation
2026-03-12 20:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d with scrape type 1
2026-03-12 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3644209b-09dd-5b84-bcc1-a7fe1973f79d sending to next pipeline
2026-03-12 20:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 3644209b-09dd-5b84-bcc1-a7fe1973f79d, identifier: 124453
2026-03-12 20:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 3644209b-09dd-5b84-bcc1-a7fe1973f79d with identifier: 124453
2026-03-12 20:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 3644209b-09dd-5b84-bcc1-a7fe1973f79d with identifier: 124453
2026-03-12 20:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 3644209b-09dd-5b84-bcc1-a7fe1973f79d with identifier: 124453 to the API
2026-03-12 20:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:10:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 113,
'expiration_date': None,
'fuel_type': 'Diesel',
'id': '3644209b-09dd-5b84-bcc1-a7fe1973f79d',
'is_damaged': False,
'is_operable': True,
'license_plate': 'AV72UES',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-t-roc-diesel-hatchback-2022-20-tdi-evo-style-5dr-124453',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'T-ROC DIESEL HATCHBACK (2022)',
'odometer': 39671,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43640,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37295,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42304,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46231,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43909,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33368,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42425,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44220,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83344,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3644209b-09dd-5b84-bcc1-a7fe1973f79d/3644209b-09dd-5b84-bcc1-a7fe1973f79d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58528,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124453/9.jpeg',
'Width': 800}],
'price': 17000.0,
'price_includes_vat': True,
'registration_date': '2022-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-ROC DIESEL HATCHBACK (2022) 2.0 TDI EVO Style 5dr',
'transmission': 'manual',
'trim': '2.0 TDI EVO Style 5dr',
'vin': 'WVGZZZA1ZPV577352',
'year': 2022}
2026-03-12 20:10:55 [arval.uk] INFO: Saving data for 124453: {'created_time': 1773346255.604951, 'last_price_update_time': 1773346255.60496}
2026-03-12 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116646)
2026-03-12 20:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67772090>
2026-03-12 20:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/8.jpeg saved to cache
2026-03-12 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c152cd8-0c8e-5dac-8343-a338673a0d06
2026-03-12 20:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116646)
2026-03-12 20:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607a6d0>
2026-03-12 20:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/7.jpeg saved to cache
2026-03-12 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c152cd8-0c8e-5dac-8343-a338673a0d06
2026-03-12 20:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116646)
2026-03-12 20:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f55150>
2026-03-12 20:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:10:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:10:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/6.jpeg saved to cache
2026-03-12 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c152cd8-0c8e-5dac-8343-a338673a0d06
2026-03-12 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121195> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e91b0060-1b06-5c03-a1f4-a662906d9aaf with identifier: 121195
2026-03-12 20:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e91b0060-1b06-5c03-a1f4-a662906d9aaf with scrape type 1
2026-03-12 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e91b0060-1b06-5c03-a1f4-a662906d9aaf
2026-03-12 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/0.jpeg not downloaded yet
2026-03-12 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/1.jpeg not downloaded yet
2026-03-12 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/2.jpeg not downloaded yet
2026-03-12 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/3.jpeg not downloaded yet
2026-03-12 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/4.jpeg not downloaded yet
2026-03-12 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/5.jpeg not downloaded yet
2026-03-12 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/6.jpeg not downloaded yet
2026-03-12 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/7.jpeg not downloaded yet
2026-03-12 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/8.jpeg not downloaded yet
2026-03-12 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/9.jpeg not downloaded yet
2026-03-12 20:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116646)
2026-03-12 20:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67122c90>
2026-03-12 20:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/5.jpeg saved to cache
2026-03-12 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c152cd8-0c8e-5dac-8343-a338673a0d06
2026-03-12 20:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117307> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a8a6469-6141-586b-81c9-d0a035c56b2e with identifier: 117307
2026-03-12 20:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a8a6469-6141-586b-81c9-d0a035c56b2e with scrape type 1
2026-03-12 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a8a6469-6141-586b-81c9-d0a035c56b2e
2026-03-12 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/0.jpeg not downloaded yet
2026-03-12 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/1.jpeg not downloaded yet
2026-03-12 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/2.jpeg not downloaded yet
2026-03-12 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/3.jpeg not downloaded yet
2026-03-12 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/4.jpeg not downloaded yet
2026-03-12 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/5.jpeg not downloaded yet
2026-03-12 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/6.jpeg not downloaded yet
2026-03-12 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/7.jpeg not downloaded yet
2026-03-12 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/8.jpeg not downloaded yet
2026-03-12 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/9.jpeg not downloaded yet
2026-03-12 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116646)
2026-03-12 20:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67663650>
2026-03-12 20:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/4.jpeg saved to cache
2026-03-12 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c152cd8-0c8e-5dac-8343-a338673a0d06
2026-03-12 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126485> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d0ff9f9-2e69-519a-8c9d-31bafbd57262 with identifier: 126485
2026-03-12 20:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262 with scrape type 1
2026-03-12 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262
2026-03-12 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/0.jpeg not downloaded yet
2026-03-12 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/1.jpeg not downloaded yet
2026-03-12 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/2.jpeg not downloaded yet
2026-03-12 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/3.jpeg not downloaded yet
2026-03-12 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/4.jpeg not downloaded yet
2026-03-12 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/5.jpeg not downloaded yet
2026-03-12 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/6.jpeg not downloaded yet
2026-03-12 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/7.jpeg not downloaded yet
2026-03-12 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/8.jpeg not downloaded yet
2026-03-12 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/9.jpeg not downloaded yet
2026-03-12 20:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116646)
2026-03-12 20:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16cd50>
2026-03-12 20:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/3.jpeg saved to cache
2026-03-12 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c152cd8-0c8e-5dac-8343-a338673a0d06
2026-03-12 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116646)
2026-03-12 20:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66076b90>
2026-03-12 20:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/2.jpeg saved to cache
2026-03-12 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c152cd8-0c8e-5dac-8343-a338673a0d06
2026-03-12 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116646)
2026-03-12 20:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676630d0>
2026-03-12 20:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/1.jpeg saved to cache
2026-03-12 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c152cd8-0c8e-5dac-8343-a338673a0d06
2026-03-12 20:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116646)
2026-03-12 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67646cd0>
2026-03-12 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/0.jpeg saved to cache
2026-03-12 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c152cd8-0c8e-5dac-8343-a338673a0d06
2026-03-12 20:11:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c152cd8-0c8e-5dac-8343-a338673a0d06, skipping ID generation
2026-03-12 20:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c152cd8-0c8e-5dac-8343-a338673a0d06 with scrape type 1
2026-03-12 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c152cd8-0c8e-5dac-8343-a338673a0d06 sending to next pipeline
2026-03-12 20:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 1c152cd8-0c8e-5dac-8343-a338673a0d06, identifier: 116646
2026-03-12 20:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 1c152cd8-0c8e-5dac-8343-a338673a0d06 with identifier: 116646
2026-03-12 20:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 1c152cd8-0c8e-5dac-8343-a338673a0d06 with identifier: 116646
2026-03-12 20:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 1c152cd8-0c8e-5dac-8343-a338673a0d06 with identifier: 116646 to the API
2026-03-12 20:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:11:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'engine_horse_power': 215,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': '1c152cd8-0c8e-5dac-8343-a338673a0d06',
'is_damaged': False,
'is_operable': True,
'license_plate': 'OE71MDU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/mercedes-a-class-hatchback-2018-a250e-amg-line-premium-5dr-auto-116646',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Mercedes',
'model': 'A CLASS HATCHBACK (2018)',
'odometer': 42204,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57326,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52432,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53537,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50744,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51500,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57435,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52526,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54596,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42129,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c152cd8-0c8e-5dac-8343-a338673a0d06/1c152cd8-0c8e-5dac-8343-a338673a0d06_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47827,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116646/9.jpeg',
'Width': 800}],
'price': 17100.0,
'price_includes_vat': True,
'registration_date': '2022-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes A CLASS HATCHBACK (2018) A250e AMG Line Premium 5dr Auto',
'transmission': 'automatic',
'trim': 'A250e AMG Line Premium 5dr Auto',
'vin': 'W1K1770862V120036',
'year': 2022}
2026-03-12 20:11:08 [arval.uk] INFO: Saving data for 116646: {'created_time': 1773346268.097982, 'last_price_update_time': 1773346268.097991}
2026-03-12 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128924)
2026-03-12 20:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef0050>
2026-03-12 20:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/7.jpeg saved to cache
2026-03-12 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe
2026-03-12 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128924)
2026-03-12 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67121bd0>
2026-03-12 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/6.jpeg saved to cache
2026-03-12 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe
2026-03-12 20:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128924)
2026-03-12 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606ba10>
2026-03-12 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/5.jpeg saved to cache
2026-03-12 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe
2026-03-12 20:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128924)
2026-03-12 20:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef3350>
2026-03-12 20:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/4.jpeg saved to cache
2026-03-12 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe
2026-03-12 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128924)
2026-03-12 20:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606a750>
2026-03-12 20:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/3.jpeg saved to cache
2026-03-12 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe
2026-03-12 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128924)
2026-03-12 20:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66066d50>
2026-03-12 20:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/2.jpeg saved to cache
2026-03-12 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe
2026-03-12 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128924)
2026-03-12 20:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbec7d0>
2026-03-12 20:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/1.jpeg saved to cache
2026-03-12 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe
2026-03-12 20:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128924)
2026-03-12 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66066cd0>
2026-03-12 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/0.jpeg saved to cache
2026-03-12 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe
2026-03-12 20:11:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe, skipping ID generation
2026-03-12 20:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe with scrape type 1
2026-03-12 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe sending to next pipeline
2026-03-12 20:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe, identifier: 128924
2026-03-12 20:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe with identifier: 128924
2026-03-12 20:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe with identifier: 128924
2026-03-12 20:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 04ef49a6-4d65-5a43-be25-ad3e3d8aacbe with identifier: 128924 to the API
2026-03-12 20:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:11:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'engine_horse_power': 201,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': '04ef49a6-4d65-5a43-be25-ad3e3d8aacbe',
'is_damaged': False,
'is_operable': True,
'license_plate': 'RK72LKG',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-a3-sportback-2020-40-tfsi-e-sport-5dr-s-tronic-comfortsound-128924',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'A3 SPORTBACK (2020)',
'odometer': 42740,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72077,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79304,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81378,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67097,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65552,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71978,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64586,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74605,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58625,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04ef49a6-4d65-5a43-be25-ad3e3d8aacbe/04ef49a6-4d65-5a43-be25-ad3e3d8aacbe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119649,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128924/9.jpeg',
'Width': 800}],
'price': 17100.0,
'price_includes_vat': True,
'registration_date': '2022-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 SPORTBACK (2020) 40 TFSI e Sport 5dr S Tronic '
'[Comfort+Sound]',
'transmission': 'automatic',
'trim': '40 TFSI e Sport 5dr S Tronic [Comfort+Sound]',
'vin': 'WAUZZZGY2PA005795',
'year': 2022}
2026-03-12 20:11:16 [arval.uk] INFO: Saving data for 128924: {'created_time': 1773346276.985389, 'last_price_update_time': 1773346276.985398}
2026-03-12 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121195)
2026-03-12 20:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67138650>
2026-03-12 20:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/9.jpeg saved to cache
2026-03-12 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e91b0060-1b06-5c03-a1f4-a662906d9aaf
2026-03-12 20:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121195)
2026-03-12 20:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18c450>
2026-03-12 20:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/8.jpeg saved to cache
2026-03-12 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e91b0060-1b06-5c03-a1f4-a662906d9aaf
2026-03-12 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117307)
2026-03-12 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b8290>
2026-03-12 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/9.jpeg saved to cache
2026-03-12 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a8a6469-6141-586b-81c9-d0a035c56b2e
2026-03-12 20:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117307)
2026-03-12 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713a750>
2026-03-12 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/8.jpeg saved to cache
2026-03-12 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a8a6469-6141-586b-81c9-d0a035c56b2e
2026-03-12 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126485)
2026-03-12 20:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f7a88d390>
2026-03-12 20:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/9.jpeg saved to cache
2026-03-12 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262
2026-03-12 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126485)
2026-03-12 20:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713af50>
2026-03-12 20:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/8.jpeg saved to cache
2026-03-12 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262
2026-03-12 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126485)
2026-03-12 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677508d0>
2026-03-12 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/7.jpeg saved to cache
2026-03-12 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262
2026-03-12 20:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126485)
2026-03-12 20:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18eb90>
2026-03-12 20:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/6.jpeg saved to cache
2026-03-12 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262
2026-03-12 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126485)
2026-03-12 20:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67781e10>
2026-03-12 20:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/5.jpeg saved to cache
2026-03-12 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262
2026-03-12 20:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126485)
2026-03-12 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66075e90>
2026-03-12 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/4.jpeg saved to cache
2026-03-12 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262
2026-03-12 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126485)
2026-03-12 20:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67120f50>
2026-03-12 20:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/3.jpeg saved to cache
2026-03-12 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262
2026-03-12 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126485)
2026-03-12 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18fe10>
2026-03-12 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/2.jpeg saved to cache
2026-03-12 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262
2026-03-12 20:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126485)
2026-03-12 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67122450>
2026-03-12 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/1.jpeg saved to cache
2026-03-12 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262
2026-03-12 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126485)
2026-03-12 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18cd50>
2026-03-12 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/0.jpeg saved to cache
2026-03-12 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262
2026-03-12 20:11:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d0ff9f9-2e69-519a-8c9d-31bafbd57262, skipping ID generation
2026-03-12 20:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262 with scrape type 1
2026-03-12 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d0ff9f9-2e69-519a-8c9d-31bafbd57262 sending to next pipeline
2026-03-12 20:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 9d0ff9f9-2e69-519a-8c9d-31bafbd57262, identifier: 126485
2026-03-12 20:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 9d0ff9f9-2e69-519a-8c9d-31bafbd57262 with identifier: 126485
2026-03-12 20:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 9d0ff9f9-2e69-519a-8c9d-31bafbd57262 with identifier: 126485
2026-03-12 20:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 9d0ff9f9-2e69-519a-8c9d-31bafbd57262 with identifier: 126485 to the API
2026-03-12 20:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:11:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 107,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '9d0ff9f9-2e69-519a-8c9d-31bafbd57262',
'is_damaged': False,
'is_operable': True,
'license_plate': 'NA72RDV',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-q2-estate-2020-30-tfsi-technik-5dr-126485',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'Q2 ESTATE (2020)',
'odometer': 9799,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43492,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37016,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43517,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43214,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42679,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33433,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41522,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43049,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33024,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d0ff9f9-2e69-519a-8c9d-31bafbd57262/9d0ff9f9-2e69-519a-8c9d-31bafbd57262_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33179,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126485/9.jpeg',
'Width': 800}],
'price': 16700.0,
'price_includes_vat': True,
'registration_date': '2022-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q2 ESTATE (2020) 30 TFSI Technik 5dr',
'transmission': 'manual',
'trim': '30 TFSI Technik 5dr',
'vin': 'WAUZZZGA1PA006035',
'year': 2022}
2026-03-12 20:11:34 [arval.uk] INFO: Saving data for 126485: {'created_time': 1773346294.647929, 'last_price_update_time': 1773346294.647939}
2026-03-12 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117307)
2026-03-12 20:11:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67128390>
2026-03-12 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/7.jpeg saved to cache
2026-03-12 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a8a6469-6141-586b-81c9-d0a035c56b2e
2026-03-12 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117307)
2026-03-12 20:11:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763b050>
2026-03-12 20:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/6.jpeg saved to cache
2026-03-12 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a8a6469-6141-586b-81c9-d0a035c56b2e
2026-03-12 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117307)
2026-03-12 20:11:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67739490>
2026-03-12 20:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/5.jpeg saved to cache
2026-03-12 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a8a6469-6141-586b-81c9-d0a035c56b2e
2026-03-12 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125156> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26d81b3c-0071-571c-8d36-b2a330405ea2 with identifier: 125156
2026-03-12 20:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26d81b3c-0071-571c-8d36-b2a330405ea2 with scrape type 1
2026-03-12 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26d81b3c-0071-571c-8d36-b2a330405ea2
2026-03-12 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/0.jpeg not downloaded yet
2026-03-12 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/1.jpeg not downloaded yet
2026-03-12 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/2.jpeg not downloaded yet
2026-03-12 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/3.jpeg not downloaded yet
2026-03-12 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/4.jpeg not downloaded yet
2026-03-12 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/5.jpeg not downloaded yet
2026-03-12 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/6.jpeg not downloaded yet
2026-03-12 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/7.jpeg not downloaded yet
2026-03-12 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/8.jpeg not downloaded yet
2026-03-12 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/9.jpeg not downloaded yet
2026-03-12 20:11:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127539> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117307)
2026-03-12 20:11:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9a08ee8-7e31-58c0-ace1-7e009906f190 with identifier: 127539
2026-03-12 20:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a08ee8-7e31-58c0-ace1-7e009906f190 with scrape type 1
2026-03-12 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9a08ee8-7e31-58c0-ace1-7e009906f190
2026-03-12 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/0.jpeg not downloaded yet
2026-03-12 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/1.jpeg not downloaded yet
2026-03-12 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/2.jpeg not downloaded yet
2026-03-12 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/3.jpeg not downloaded yet
2026-03-12 20:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66075d50>
2026-03-12 20:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/4.jpeg saved to cache
2026-03-12 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a8a6469-6141-586b-81c9-d0a035c56b2e
2026-03-12 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/4.jpeg not downloaded yet
2026-03-12 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/5.jpeg not downloaded yet
2026-03-12 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/6.jpeg not downloaded yet
2026-03-12 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/7.jpeg not downloaded yet
2026-03-12 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/8.jpeg not downloaded yet
2026-03-12 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/9.jpeg not downloaded yet
2026-03-12 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117307)
2026-03-12 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128778> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6602e890>
2026-03-12 20:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/3.jpeg saved to cache
2026-03-12 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a8a6469-6141-586b-81c9-d0a035c56b2e
2026-03-12 20:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 236f0728-9bd5-591c-8871-65b4b3c848d2 with identifier: 128778
2026-03-12 20:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 236f0728-9bd5-591c-8871-65b4b3c848d2 with scrape type 1
2026-03-12 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 236f0728-9bd5-591c-8871-65b4b3c848d2
2026-03-12 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/0.jpeg not downloaded yet
2026-03-12 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/1.jpeg not downloaded yet
2026-03-12 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/2.jpeg not downloaded yet
2026-03-12 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/3.jpeg not downloaded yet
2026-03-12 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/4.jpeg not downloaded yet
2026-03-12 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/5.jpeg not downloaded yet
2026-03-12 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/6.jpeg not downloaded yet
2026-03-12 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/7.jpeg not downloaded yet
2026-03-12 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/8.jpeg not downloaded yet
2026-03-12 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/9.jpeg not downloaded yet
2026-03-12 20:11:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117307)
2026-03-12 20:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66080610>
2026-03-12 20:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/2.jpeg saved to cache
2026-03-12 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a8a6469-6141-586b-81c9-d0a035c56b2e
2026-03-12 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117307)
2026-03-12 20:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b6fd0>
2026-03-12 20:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/1.jpeg saved to cache
2026-03-12 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a8a6469-6141-586b-81c9-d0a035c56b2e
2026-03-12 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117307)
2026-03-12 20:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67704b10>
2026-03-12 20:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/0.jpeg saved to cache
2026-03-12 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a8a6469-6141-586b-81c9-d0a035c56b2e
2026-03-12 20:11:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a8a6469-6141-586b-81c9-d0a035c56b2e, skipping ID generation
2026-03-12 20:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a8a6469-6141-586b-81c9-d0a035c56b2e with scrape type 1
2026-03-12 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a8a6469-6141-586b-81c9-d0a035c56b2e sending to next pipeline
2026-03-12 20:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 6a8a6469-6141-586b-81c9-d0a035c56b2e, identifier: 117307
2026-03-12 20:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 6a8a6469-6141-586b-81c9-d0a035c56b2e with identifier: 117307
2026-03-12 20:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 6a8a6469-6141-586b-81c9-d0a035c56b2e with identifier: 117307
2026-03-12 20:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 6a8a6469-6141-586b-81c9-d0a035c56b2e with identifier: 117307 to the API
2026-03-12 20:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:11:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:11:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 169,
'expiration_date': None,
'fuel_type': 'Electric',
'id': '6a8a6469-6141-586b-81c9-d0a035c56b2e',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DY73HCC',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-ioniq-5-electric-hatchback-2021-125kw-premium-58-kwh-5dr-auto-117307',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Hyundai',
'model': 'IONIQ 5 ELECTRIC HATCHBACK (2021)',
'odometer': 10588,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73795,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70410,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92897,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64678,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82430,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88238,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74116,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63191,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78876,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a8a6469-6141-586b-81c9-d0a035c56b2e/6a8a6469-6141-586b-81c9-d0a035c56b2e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52283,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117307/9.jpeg',
'Width': 800}],
'price': 16900.0,
'price_includes_vat': True,
'registration_date': '2023-09-13',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai IONIQ 5 ELECTRIC HATCHBACK (2021) 125kW Premium 58 kWh 5dr '
'Auto',
'transmission': 'automatic',
'trim': '125kW Premium 58 kWh 5dr Auto',
'vin': 'KMHKN81BUPU183513',
'year': 2023}
2026-03-12 20:11:44 [arval.uk] INFO: Saving data for 117307: {'created_time': 1773346304.645731, 'last_price_update_time': 1773346304.645741}
2026-03-12 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121195)
2026-03-12 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607a890>
2026-03-12 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/7.jpeg saved to cache
2026-03-12 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e91b0060-1b06-5c03-a1f4-a662906d9aaf
2026-03-12 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121195)
2026-03-12 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717aa10>
2026-03-12 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/6.jpeg saved to cache
2026-03-12 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e91b0060-1b06-5c03-a1f4-a662906d9aaf
2026-03-12 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121195)
2026-03-12 20:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ae790>
2026-03-12 20:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/5.jpeg saved to cache
2026-03-12 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e91b0060-1b06-5c03-a1f4-a662906d9aaf
2026-03-12 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121195)
2026-03-12 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66053d90>
2026-03-12 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/4.jpeg saved to cache
2026-03-12 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e91b0060-1b06-5c03-a1f4-a662906d9aaf
2026-03-12 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121195)
2026-03-12 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67751810>
2026-03-12 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/3.jpeg saved to cache
2026-03-12 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e91b0060-1b06-5c03-a1f4-a662906d9aaf
2026-03-12 20:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121195)
2026-03-12 20:11:51 [scrapy.extensions.logstats] INFO: Crawled 110 pages (at 7 pages/min), scraped 78 items (at 5 items/min)
2026-03-12 20:11:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660bb450>
2026-03-12 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/2.jpeg saved to cache
2026-03-12 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e91b0060-1b06-5c03-a1f4-a662906d9aaf
2026-03-12 20:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121186> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 854f8065-77ac-5c79-bd3b-870dcb709b1a with identifier: 121186
2026-03-12 20:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 854f8065-77ac-5c79-bd3b-870dcb709b1a with scrape type 1
2026-03-12 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 854f8065-77ac-5c79-bd3b-870dcb709b1a
2026-03-12 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/0.jpeg not downloaded yet
2026-03-12 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/1.jpeg not downloaded yet
2026-03-12 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/2.jpeg not downloaded yet
2026-03-12 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/3.jpeg not downloaded yet
2026-03-12 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/4.jpeg not downloaded yet
2026-03-12 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/5.jpeg not downloaded yet
2026-03-12 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/6.jpeg not downloaded yet
2026-03-12 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/7.jpeg not downloaded yet
2026-03-12 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/8.jpeg not downloaded yet
2026-03-12 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/9.jpeg not downloaded yet
2026-03-12 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121195)
2026-03-12 20:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67661950>
2026-03-12 20:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/1.jpeg saved to cache
2026-03-12 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e91b0060-1b06-5c03-a1f4-a662906d9aaf
2026-03-12 20:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121195)
2026-03-12 20:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67706fd0>
2026-03-12 20:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/0.jpeg saved to cache
2026-03-12 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e91b0060-1b06-5c03-a1f4-a662906d9aaf
2026-03-12 20:11:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e91b0060-1b06-5c03-a1f4-a662906d9aaf, skipping ID generation
2026-03-12 20:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e91b0060-1b06-5c03-a1f4-a662906d9aaf with scrape type 1
2026-03-12 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e91b0060-1b06-5c03-a1f4-a662906d9aaf sending to next pipeline
2026-03-12 20:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: e91b0060-1b06-5c03-a1f4-a662906d9aaf, identifier: 121195
2026-03-12 20:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: e91b0060-1b06-5c03-a1f4-a662906d9aaf with identifier: 121195
2026-03-12 20:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: e91b0060-1b06-5c03-a1f4-a662906d9aaf with identifier: 121195
2026-03-12 20:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: e91b0060-1b06-5c03-a1f4-a662906d9aaf with identifier: 121195 to the API
2026-03-12 20:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:11:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'engine_horse_power': 137,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': 'e91b0060-1b06-5c03-a1f4-a662906d9aaf',
'is_damaged': False,
'is_operable': True,
'license_plate': 'LO23WGJ',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/toyota-corolla-touring-sport-2018-18-vvt-i-hybrid-icon-tech-5dr-cvt-121195',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Toyota',
'model': 'COROLLA TOURING SPORT (2018)',
'odometer': 49746,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 46,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77389,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85416,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77741,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75488,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98434,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94518,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78782,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18449,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55363,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e91b0060-1b06-5c03-a1f4-a662906d9aaf/e91b0060-1b06-5c03-a1f4-a662906d9aaf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61265,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121195/9.jpeg',
'Width': 800}],
'price': 16900.0,
'price_includes_vat': True,
'registration_date': '2023-08-20',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota COROLLA TOURING SPORT (2018) 1.8 VVT-i Hybrid Icon Tech 5dr '
'CVT',
'transmission': 'automatic',
'trim': '1.8 VVT-i Hybrid Icon Tech 5dr CVT',
'vin': 'SB1ZB3AE00E028532',
'year': 2023}
2026-03-12 20:11:54 [arval.uk] INFO: Saving data for 121195: {'created_time': 1773346314.801461, 'last_price_update_time': 1773346314.801471}
2026-03-12 20:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125156)
2026-03-12 20:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b8710>
2026-03-12 20:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/9.jpeg saved to cache
2026-03-12 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26d81b3c-0071-571c-8d36-b2a330405ea2
2026-03-12 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125156)
2026-03-12 20:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66050390>
2026-03-12 20:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/8.jpeg saved to cache
2026-03-12 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26d81b3c-0071-571c-8d36-b2a330405ea2
2026-03-12 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127539)
2026-03-12 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606a710>
2026-03-12 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/9.jpeg saved to cache
2026-03-12 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9a08ee8-7e31-58c0-ace1-7e009906f190
2026-03-12 20:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127539)
2026-03-12 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67707750>
2026-03-12 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/8.jpeg saved to cache
2026-03-12 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9a08ee8-7e31-58c0-ace1-7e009906f190
2026-03-12 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128778)
2026-03-12 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67663710>
2026-03-12 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/9.jpeg saved to cache
2026-03-12 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 236f0728-9bd5-591c-8871-65b4b3c848d2
2026-03-12 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128778)
2026-03-12 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a06d0>
2026-03-12 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/8.jpeg saved to cache
2026-03-12 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 236f0728-9bd5-591c-8871-65b4b3c848d2
2026-03-12 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128778)
2026-03-12 20:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67639950>
2026-03-12 20:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/7.jpeg saved to cache
2026-03-12 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 236f0728-9bd5-591c-8871-65b4b3c848d2
2026-03-12 20:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128778)
2026-03-12 20:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c17b010>
2026-03-12 20:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/6.jpeg saved to cache
2026-03-12 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 236f0728-9bd5-591c-8871-65b4b3c848d2
2026-03-12 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128778)
2026-03-12 20:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67660bd0>
2026-03-12 20:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/5.jpeg saved to cache
2026-03-12 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 236f0728-9bd5-591c-8871-65b4b3c848d2
2026-03-12 20:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128778)
2026-03-12 20:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766cd50>
2026-03-12 20:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/4.jpeg saved to cache
2026-03-12 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 236f0728-9bd5-591c-8871-65b4b3c848d2
2026-03-12 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128778)
2026-03-12 20:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16cf50>
2026-03-12 20:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/3.jpeg saved to cache
2026-03-12 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 236f0728-9bd5-591c-8871-65b4b3c848d2
2026-03-12 20:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128778)
2026-03-12 20:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67663a50>
2026-03-12 20:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/2.jpeg saved to cache
2026-03-12 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 236f0728-9bd5-591c-8871-65b4b3c848d2
2026-03-12 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128778)
2026-03-12 20:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66050250>
2026-03-12 20:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/1.jpeg saved to cache
2026-03-12 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 236f0728-9bd5-591c-8871-65b4b3c848d2
2026-03-12 20:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128778)
2026-03-12 20:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778e810>
2026-03-12 20:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/0.jpeg saved to cache
2026-03-12 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 236f0728-9bd5-591c-8871-65b4b3c848d2
2026-03-12 20:12:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 236f0728-9bd5-591c-8871-65b4b3c848d2, skipping ID generation
2026-03-12 20:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 236f0728-9bd5-591c-8871-65b4b3c848d2 with scrape type 1
2026-03-12 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 236f0728-9bd5-591c-8871-65b4b3c848d2 sending to next pipeline
2026-03-12 20:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 236f0728-9bd5-591c-8871-65b4b3c848d2, identifier: 128778
2026-03-12 20:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 236f0728-9bd5-591c-8871-65b4b3c848d2 with identifier: 128778
2026-03-12 20:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 236f0728-9bd5-591c-8871-65b4b3c848d2 with identifier: 128778
2026-03-12 20:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 236f0728-9bd5-591c-8871-65b4b3c848d2 with identifier: 128778 to the API
2026-03-12 20:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:12:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '236f0728-9bd5-591c-8871-65b4b3c848d2',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DY22YUL',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-kuga-estate-2019-15-ecoboost-150-st-line-edition-5dr-128778',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'KUGA ESTATE (2019)',
'odometer': 30275,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73502,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64178,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81116,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67202,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82199,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70695,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76701,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80787,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56018,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_236f0728-9bd5-591c-8871-65b4b3c848d2/236f0728-9bd5-591c-8871-65b4b3c848d2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100083,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128778/9.jpeg',
'Width': 800}],
'price': 16200.0,
'price_includes_vat': True,
'registration_date': '2022-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford KUGA ESTATE (2019) 1.5 EcoBoost 150 ST-Line Edition 5dr',
'transmission': 'manual',
'trim': '1.5 EcoBoost 150 ST-Line Edition 5dr',
'vin': 'WF0FXXWPMFNS87436',
'year': 2022}
2026-03-12 20:12:11 [arval.uk] INFO: Saving data for 128778: {'created_time': 1773346331.449963, 'last_price_update_time': 1773346331.449973}
2026-03-12 20:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121186)
2026-03-12 20:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66051a50>
2026-03-12 20:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/9.jpeg saved to cache
2026-03-12 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 854f8065-77ac-5c79-bd3b-870dcb709b1a
2026-03-12 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121186)
2026-03-12 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee0ad0>
2026-03-12 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/8.jpeg saved to cache
2026-03-12 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 854f8065-77ac-5c79-bd3b-870dcb709b1a
2026-03-12 20:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121186)
2026-03-12 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67704d50>
2026-03-12 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/7.jpeg saved to cache
2026-03-12 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 854f8065-77ac-5c79-bd3b-870dcb709b1a
2026-03-12 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121186)
2026-03-12 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67645f50>
2026-03-12 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/6.jpeg saved to cache
2026-03-12 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 854f8065-77ac-5c79-bd3b-870dcb709b1a
2026-03-12 20:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121186)
2026-03-12 20:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66076cd0>
2026-03-12 20:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/5.jpeg saved to cache
2026-03-12 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 854f8065-77ac-5c79-bd3b-870dcb709b1a
2026-03-12 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121186)
2026-03-12 20:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718dd10>
2026-03-12 20:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/4.jpeg saved to cache
2026-03-12 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 854f8065-77ac-5c79-bd3b-870dcb709b1a
2026-03-12 20:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121186)
2026-03-12 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c17a390>
2026-03-12 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/3.jpeg saved to cache
2026-03-12 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 854f8065-77ac-5c79-bd3b-870dcb709b1a
2026-03-12 20:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121186)
2026-03-12 20:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766de10>
2026-03-12 20:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/2.jpeg saved to cache
2026-03-12 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 854f8065-77ac-5c79-bd3b-870dcb709b1a
2026-03-12 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121186)
2026-03-12 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66074250>
2026-03-12 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/1.jpeg saved to cache
2026-03-12 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 854f8065-77ac-5c79-bd3b-870dcb709b1a
2026-03-12 20:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121186)
2026-03-12 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67751d90>
2026-03-12 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/0.jpeg saved to cache
2026-03-12 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 854f8065-77ac-5c79-bd3b-870dcb709b1a
2026-03-12 20:12:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 854f8065-77ac-5c79-bd3b-870dcb709b1a, skipping ID generation
2026-03-12 20:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 854f8065-77ac-5c79-bd3b-870dcb709b1a with scrape type 1
2026-03-12 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 854f8065-77ac-5c79-bd3b-870dcb709b1a sending to next pipeline
2026-03-12 20:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 854f8065-77ac-5c79-bd3b-870dcb709b1a, identifier: 121186
2026-03-12 20:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 854f8065-77ac-5c79-bd3b-870dcb709b1a with identifier: 121186
2026-03-12 20:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 854f8065-77ac-5c79-bd3b-870dcb709b1a with identifier: 121186
2026-03-12 20:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 854f8065-77ac-5c79-bd3b-870dcb709b1a with identifier: 121186 to the API
2026-03-12 20:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:12:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'engine_horse_power': 242,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': '854f8065-77ac-5c79-bd3b-870dcb709b1a',
'is_damaged': False,
'is_operable': True,
'license_plate': 'RA21EZN',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-14-tsi-gte-5dr-dsg-121186',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 39104,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61257,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55814,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48761,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50532,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148135,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86341,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116302,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101937,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109678,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_854f8065-77ac-5c79-bd3b-870dcb709b1a/854f8065-77ac-5c79-bd3b-870dcb709b1a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96092,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121186/9.jpeg',
'Width': 1280}],
'price': 16700.0,
'price_includes_vat': True,
'registration_date': '2021-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 1.4 TSI GTE 5dr DSG',
'transmission': 'automatic',
'trim': '1.4 TSI GTE 5dr DSG',
'vin': 'WVWZZZCDZMW360414',
'year': 2021}
2026-03-12 20:12:23 [arval.uk] INFO: Saving data for 121186: {'created_time': 1773346343.876898, 'last_price_update_time': 1773346343.876908}
2026-03-12 20:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127539)
2026-03-12 20:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6771ac50>
2026-03-12 20:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/7.jpeg saved to cache
2026-03-12 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9a08ee8-7e31-58c0-ace1-7e009906f190
2026-03-12 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127539)
2026-03-12 20:12:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127891> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67751b50>
2026-03-12 20:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/6.jpeg saved to cache
2026-03-12 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9a08ee8-7e31-58c0-ace1-7e009906f190
2026-03-12 20:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be1bd72a-20e3-5a96-bf9c-934c0f8cd804 with identifier: 127891
2026-03-12 20:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804 with scrape type 1
2026-03-12 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804
2026-03-12 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/0.jpeg not downloaded yet
2026-03-12 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/1.jpeg not downloaded yet
2026-03-12 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/2.jpeg not downloaded yet
2026-03-12 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/3.jpeg not downloaded yet
2026-03-12 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/4.jpeg not downloaded yet
2026-03-12 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/5.jpeg not downloaded yet
2026-03-12 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/6.jpeg not downloaded yet
2026-03-12 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/7.jpeg not downloaded yet
2026-03-12 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/8.jpeg not downloaded yet
2026-03-12 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/9.jpeg not downloaded yet
2026-03-12 20:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127539)
2026-03-12 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f46ed0>
2026-03-12 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/5.jpeg saved to cache
2026-03-12 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9a08ee8-7e31-58c0-ace1-7e009906f190
2026-03-12 20:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127503> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799 with identifier: 127503
2026-03-12 20:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799 with scrape type 1
2026-03-12 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799
2026-03-12 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/0.jpeg not downloaded yet
2026-03-12 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/1.jpeg not downloaded yet
2026-03-12 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/2.jpeg not downloaded yet
2026-03-12 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/3.jpeg not downloaded yet
2026-03-12 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/4.jpeg not downloaded yet
2026-03-12 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/5.jpeg not downloaded yet
2026-03-12 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/6.jpeg not downloaded yet
2026-03-12 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/7.jpeg not downloaded yet
2026-03-12 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/8.jpeg not downloaded yet
2026-03-12 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/9.jpeg not downloaded yet
2026-03-12 20:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125534> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5b71f2d-4831-54e5-afe8-755aeb2934d3 with identifier: 125534
2026-03-12 20:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5b71f2d-4831-54e5-afe8-755aeb2934d3 with scrape type 1
2026-03-12 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5b71f2d-4831-54e5-afe8-755aeb2934d3
2026-03-12 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/0.jpeg not downloaded yet
2026-03-12 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/1.jpeg not downloaded yet
2026-03-12 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/2.jpeg not downloaded yet
2026-03-12 20:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127539)
2026-03-12 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/3.jpeg not downloaded yet
2026-03-12 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/4.jpeg not downloaded yet
2026-03-12 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/5.jpeg not downloaded yet
2026-03-12 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/6.jpeg not downloaded yet
2026-03-12 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/7.jpeg not downloaded yet
2026-03-12 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/8.jpeg not downloaded yet
2026-03-12 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/9.jpeg not downloaded yet
2026-03-12 20:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66051690>
2026-03-12 20:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/4.jpeg saved to cache
2026-03-12 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9a08ee8-7e31-58c0-ace1-7e009906f190
2026-03-12 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127539)
2026-03-12 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18c290>
2026-03-12 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/3.jpeg saved to cache
2026-03-12 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9a08ee8-7e31-58c0-ace1-7e009906f190
2026-03-12 20:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127539)
2026-03-12 20:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f8de50>
2026-03-12 20:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/2.jpeg saved to cache
2026-03-12 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9a08ee8-7e31-58c0-ace1-7e009906f190
2026-03-12 20:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127539)
2026-03-12 20:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c178690>
2026-03-12 20:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/1.jpeg saved to cache
2026-03-12 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9a08ee8-7e31-58c0-ace1-7e009906f190
2026-03-12 20:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127539)
2026-03-12 20:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f8c810>
2026-03-12 20:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/0.jpeg saved to cache
2026-03-12 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9a08ee8-7e31-58c0-ace1-7e009906f190
2026-03-12 20:12:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9a08ee8-7e31-58c0-ace1-7e009906f190, skipping ID generation
2026-03-12 20:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a08ee8-7e31-58c0-ace1-7e009906f190 with scrape type 1
2026-03-12 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9a08ee8-7e31-58c0-ace1-7e009906f190 sending to next pipeline
2026-03-12 20:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: a9a08ee8-7e31-58c0-ace1-7e009906f190, identifier: 127539
2026-03-12 20:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: a9a08ee8-7e31-58c0-ace1-7e009906f190 with identifier: 127539
2026-03-12 20:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: a9a08ee8-7e31-58c0-ace1-7e009906f190 with identifier: 127539
2026-03-12 20:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: a9a08ee8-7e31-58c0-ace1-7e009906f190 with identifier: 127539 to the API
2026-03-12 20:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:12:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 107,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'a9a08ee8-7e31-58c0-ace1-7e009906f190',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YA72KXC',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-t-roc-hatchback-2022-10-tsi-life-5dr-127539',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'T-ROC HATCHBACK (2022)',
'odometer': 23629,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80789,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75050,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83313,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81048,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88216,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84364,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90218,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72092,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57739,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a08ee8-7e31-58c0-ace1-7e009906f190/a9a08ee8-7e31-58c0-ace1-7e009906f190_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91332,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127539/9.jpeg',
'Width': 800}],
'price': 16400.0,
'price_includes_vat': True,
'registration_date': '2023-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-ROC HATCHBACK (2022) 1.0 TSI Life 5dr',
'transmission': 'manual',
'trim': '1.0 TSI Life 5dr',
'vin': 'WVGZZZA1ZPV552262',
'year': 2023}
2026-03-12 20:12:34 [arval.uk] INFO: Saving data for 127539: {'created_time': 1773346354.428836, 'last_price_update_time': 1773346354.428846}
2026-03-12 20:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125156)
2026-03-12 20:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18f810>
2026-03-12 20:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/7.jpeg saved to cache
2026-03-12 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26d81b3c-0071-571c-8d36-b2a330405ea2
2026-03-12 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125156)
2026-03-12 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660767d0>
2026-03-12 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/6.jpeg saved to cache
2026-03-12 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26d81b3c-0071-571c-8d36-b2a330405ea2
2026-03-12 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125156)
2026-03-12 20:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a6090>
2026-03-12 20:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/5.jpeg saved to cache
2026-03-12 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26d81b3c-0071-571c-8d36-b2a330405ea2
2026-03-12 20:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125156)
2026-03-12 20:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66076cd0>
2026-03-12 20:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/4.jpeg saved to cache
2026-03-12 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26d81b3c-0071-571c-8d36-b2a330405ea2
2026-03-12 20:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125156)
2026-03-12 20:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67198dd0>
2026-03-12 20:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/3.jpeg saved to cache
2026-03-12 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26d81b3c-0071-571c-8d36-b2a330405ea2
2026-03-12 20:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125156)
2026-03-12 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67752750>
2026-03-12 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/2.jpeg saved to cache
2026-03-12 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26d81b3c-0071-571c-8d36-b2a330405ea2
2026-03-12 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125156)
2026-03-12 20:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66075ed0>
2026-03-12 20:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/1.jpeg saved to cache
2026-03-12 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26d81b3c-0071-571c-8d36-b2a330405ea2
2026-03-12 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125156)
2026-03-12 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c179d10>
2026-03-12 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/0.jpeg saved to cache
2026-03-12 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26d81b3c-0071-571c-8d36-b2a330405ea2
2026-03-12 20:12:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26d81b3c-0071-571c-8d36-b2a330405ea2, skipping ID generation
2026-03-12 20:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26d81b3c-0071-571c-8d36-b2a330405ea2 with scrape type 1
2026-03-12 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26d81b3c-0071-571c-8d36-b2a330405ea2 sending to next pipeline
2026-03-12 20:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 26d81b3c-0071-571c-8d36-b2a330405ea2, identifier: 125156
2026-03-12 20:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 26d81b3c-0071-571c-8d36-b2a330405ea2 with identifier: 125156
2026-03-12 20:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 26d81b3c-0071-571c-8d36-b2a330405ea2 with identifier: 125156
2026-03-12 20:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 26d81b3c-0071-571c-8d36-b2a330405ea2 with identifier: 125156 to the API
2026-03-12 20:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:12:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'engine_horse_power': 137,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': '26d81b3c-0071-571c-8d36-b2a330405ea2',
'is_damaged': False,
'is_operable': True,
'license_plate': 'SM72OSU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/toyota-corolla-hatchback-2018-18-vvt-i-hybrid-design-5dr-cvt-125156',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Toyota',
'model': 'COROLLA HATCHBACK (2018)',
'odometer': 43437,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56484,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46839,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56580,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56149,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45637,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150672,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61818,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98453,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79550,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26d81b3c-0071-571c-8d36-b2a330405ea2/26d81b3c-0071-571c-8d36-b2a330405ea2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72614,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/125156/9.jpeg',
'Width': 1280}],
'price': 16600.0,
'price_includes_vat': True,
'registration_date': '2022-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota COROLLA HATCHBACK (2018) 1.8 VVT-i Hybrid Design 5dr CVT',
'transmission': 'automatic',
'trim': '1.8 VVT-i Hybrid Design 5dr CVT',
'vin': 'SB1K93BE30E360248',
'year': 2022}
2026-03-12 20:12:44 [arval.uk] INFO: Saving data for 125156: {'created_time': 1773346364.228884, 'last_price_update_time': 1773346364.228894}
2026-03-12 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127891)
2026-03-12 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6773b890>
2026-03-12 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/9.jpeg saved to cache
2026-03-12 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804
2026-03-12 20:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127891)
2026-03-12 20:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67121390>
2026-03-12 20:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/8.jpeg saved to cache
2026-03-12 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804
2026-03-12 20:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127503)
2026-03-12 20:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a0c50>
2026-03-12 20:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/9.jpeg saved to cache
2026-03-12 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799
2026-03-12 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125534)
2026-03-12 20:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67705590>
2026-03-12 20:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/2.jpeg saved to cache
2026-03-12 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5b71f2d-4831-54e5-afe8-755aeb2934d3
2026-03-12 20:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125534)
2026-03-12 20:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677c8610>
2026-03-12 20:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/9.jpeg saved to cache
2026-03-12 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5b71f2d-4831-54e5-afe8-755aeb2934d3
2026-03-12 20:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125534)
2026-03-12 20:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c17afd0>
2026-03-12 20:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/8.jpeg saved to cache
2026-03-12 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5b71f2d-4831-54e5-afe8-755aeb2934d3
2026-03-12 20:12:51 [scrapy.extensions.logstats] INFO: Crawled 113 pages (at 3 pages/min), scraped 83 items (at 5 items/min)
2026-03-12 20:12:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125534)
2026-03-12 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b4e90>
2026-03-12 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/7.jpeg saved to cache
2026-03-12 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5b71f2d-4831-54e5-afe8-755aeb2934d3
2026-03-12 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125534)
2026-03-12 20:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5c3d0>
2026-03-12 20:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/6.jpeg saved to cache
2026-03-12 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5b71f2d-4831-54e5-afe8-755aeb2934d3
2026-03-12 20:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125534)
2026-03-12 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f671449d0>
2026-03-12 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/5.jpeg saved to cache
2026-03-12 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5b71f2d-4831-54e5-afe8-755aeb2934d3
2026-03-12 20:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125534)
2026-03-12 20:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5d990>
2026-03-12 20:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/4.jpeg saved to cache
2026-03-12 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5b71f2d-4831-54e5-afe8-755aeb2934d3
2026-03-12 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125534)
2026-03-12 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedb550>
2026-03-12 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/3.jpeg saved to cache
2026-03-12 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5b71f2d-4831-54e5-afe8-755aeb2934d3
2026-03-12 20:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125534)
2026-03-12 20:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16c910>
2026-03-12 20:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:12:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:12:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/1.jpeg saved to cache
2026-03-12 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5b71f2d-4831-54e5-afe8-755aeb2934d3
2026-03-12 20:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125534)
2026-03-12 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedb150>
2026-03-12 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/0.jpeg saved to cache
2026-03-12 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5b71f2d-4831-54e5-afe8-755aeb2934d3
2026-03-12 20:13:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5b71f2d-4831-54e5-afe8-755aeb2934d3, skipping ID generation
2026-03-12 20:13:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5b71f2d-4831-54e5-afe8-755aeb2934d3 with scrape type 1
2026-03-12 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5b71f2d-4831-54e5-afe8-755aeb2934d3 sending to next pipeline
2026-03-12 20:13:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: b5b71f2d-4831-54e5-afe8-755aeb2934d3, identifier: 125534
2026-03-12 20:13:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: b5b71f2d-4831-54e5-afe8-755aeb2934d3 with identifier: 125534
2026-03-12 20:13:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: b5b71f2d-4831-54e5-afe8-755aeb2934d3 with identifier: 125534
2026-03-12 20:13:00 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: b5b71f2d-4831-54e5-afe8-755aeb2934d3 with identifier: 125534 to the API
2026-03-12 20:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:13:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:13:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'engine_horse_power': 242,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': 'b5b71f2d-4831-54e5-afe8-755aeb2934d3',
'is_damaged': False,
'is_operable': True,
'license_plate': 'VN72LWW',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-golf-hatchback-2020-14-tsi-gte-5dr-dsg-125534',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'GOLF HATCHBACK (2020)',
'odometer': 66157,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43521,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37130,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43373,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43696,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33115,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42948,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110860,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71719,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64547,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5b71f2d-4831-54e5-afe8-755aeb2934d3/b5b71f2d-4831-54e5-afe8-755aeb2934d3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51447,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125534/9.jpeg',
'Width': 800}],
'price': 16100.0,
'price_includes_vat': True,
'registration_date': '2022-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen GOLF HATCHBACK (2020) 1.4 TSI GTE 5dr DSG',
'transmission': 'automatic',
'trim': '1.4 TSI GTE 5dr DSG',
'vin': 'WVWZZZCD5PW306814',
'year': 2022}
2026-03-12 20:13:00 [arval.uk] INFO: Saving data for 125534: {'created_time': 1773346380.571435, 'last_price_update_time': 1773346380.571446}
2026-03-12 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127503)
2026-03-12 20:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67752690>
2026-03-12 20:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/8.jpeg saved to cache
2026-03-12 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799
2026-03-12 20:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127503)
2026-03-12 20:13:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67121d90>
2026-03-12 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/7.jpeg saved to cache
2026-03-12 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799
2026-03-12 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127503)
2026-03-12 20:13:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbe4790>
2026-03-12 20:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/6.jpeg saved to cache
2026-03-12 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799
2026-03-12 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121092> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49b41ca5-c207-5ad2-a614-082d8194942b with identifier: 121092
2026-03-12 20:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49b41ca5-c207-5ad2-a614-082d8194942b with scrape type 1
2026-03-12 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49b41ca5-c207-5ad2-a614-082d8194942b
2026-03-12 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/0.jpeg not downloaded yet
2026-03-12 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/1.jpeg not downloaded yet
2026-03-12 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/2.jpeg not downloaded yet
2026-03-12 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/3.jpeg not downloaded yet
2026-03-12 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/4.jpeg not downloaded yet
2026-03-12 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/5.jpeg not downloaded yet
2026-03-12 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/6.jpeg not downloaded yet
2026-03-12 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/7.jpeg not downloaded yet
2026-03-12 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/8.jpeg not downloaded yet
2026-03-12 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/9.jpeg not downloaded yet
2026-03-12 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127503)
2026-03-12 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67645f50>
2026-03-12 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/5.jpeg saved to cache
2026-03-12 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799
2026-03-12 20:13:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124560> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b431f688-82cd-58b3-ab0e-c6776880557d with identifier: 124560
2026-03-12 20:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b431f688-82cd-58b3-ab0e-c6776880557d with scrape type 1
2026-03-12 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b431f688-82cd-58b3-ab0e-c6776880557d
2026-03-12 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/0.jpeg not downloaded yet
2026-03-12 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/1.jpeg not downloaded yet
2026-03-12 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/2.jpeg not downloaded yet
2026-03-12 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/3.jpeg not downloaded yet
2026-03-12 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/4.jpeg not downloaded yet
2026-03-12 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/5.jpeg not downloaded yet
2026-03-12 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/6.jpeg not downloaded yet
2026-03-12 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/7.jpeg not downloaded yet
2026-03-12 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/8.jpeg not downloaded yet
2026-03-12 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/9.jpeg not downloaded yet
2026-03-12 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127503)
2026-03-12 20:13:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16fd90>
2026-03-12 20:13:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/4.jpeg saved to cache
2026-03-12 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799
2026-03-12 20:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127326> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:13:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43 with identifier: 127326
2026-03-12 20:13:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43 with scrape type 1
2026-03-12 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43
2026-03-12 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/0.jpeg not downloaded yet
2026-03-12 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/1.jpeg not downloaded yet
2026-03-12 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/2.jpeg not downloaded yet
2026-03-12 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/3.jpeg not downloaded yet
2026-03-12 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/4.jpeg not downloaded yet
2026-03-12 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/5.jpeg not downloaded yet
2026-03-12 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/6.jpeg not downloaded yet
2026-03-12 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/7.jpeg not downloaded yet
2026-03-12 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/8.jpeg not downloaded yet
2026-03-12 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/9.jpeg not downloaded yet
2026-03-12 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127503)
2026-03-12 20:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb6550>
2026-03-12 20:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/3.jpeg saved to cache
2026-03-12 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799
2026-03-12 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127503)
2026-03-12 20:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f576d0>
2026-03-12 20:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/2.jpeg saved to cache
2026-03-12 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799
2026-03-12 20:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127503)
2026-03-12 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18efd0>
2026-03-12 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/1.jpeg saved to cache
2026-03-12 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799
2026-03-12 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127503)
2026-03-12 20:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67639390>
2026-03-12 20:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/0.jpeg saved to cache
2026-03-12 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799
2026-03-12 20:13:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799, skipping ID generation
2026-03-12 20:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799 with scrape type 1
2026-03-12 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799 sending to next pipeline
2026-03-12 20:13:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799, identifier: 127503
2026-03-12 20:13:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799 with identifier: 127503
2026-03-12 20:13:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799 with identifier: 127503
2026-03-12 20:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 3ed5fbf7-964a-5c2a-8e30-b27a7fee5799 with identifier: 127503 to the API
2026-03-12 20:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:13:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 177,
'expiration_date': None,
'fuel_type': 'Electric',
'id': '3ed5fbf7-964a-5c2a-8e30-b27a7fee5799',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BV71NRU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/skoda-enyaq-iv-estate-2021-132kw-60-lounge-nav-62kwh-5dr-auto-127503',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Skoda',
'model': 'ENYAQ IV ESTATE (2021)',
'odometer': 31660,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47560,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39861,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48419,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50891,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40532,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48571,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47167,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46098,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71152,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ed5fbf7-964a-5c2a-8e30-b27a7fee5799/3ed5fbf7-964a-5c2a-8e30-b27a7fee5799_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86942,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127503/9.jpeg',
'Width': 800}],
'price': 16200.0,
'price_includes_vat': True,
'registration_date': '2022-01-05',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda ENYAQ IV ESTATE (2021) 132kW 60 Lounge Nav 62kWh 5dr Auto',
'transmission': 'automatic',
'trim': '132kW 60 Lounge Nav 62kWh 5dr Auto',
'vin': 'TMBKB7NY4NF016569',
'year': 2022}
2026-03-12 20:13:10 [arval.uk] INFO: Saving data for 127503: {'created_time': 1773346390.971663, 'last_price_update_time': 1773346390.971673}
2026-03-12 20:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127891)
2026-03-12 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f37190>
2026-03-12 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/7.jpeg saved to cache
2026-03-12 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804
2026-03-12 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127891)
2026-03-12 20:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b9150>
2026-03-12 20:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/6.jpeg saved to cache
2026-03-12 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804
2026-03-12 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127891)
2026-03-12 20:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677cb810>
2026-03-12 20:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/5.jpeg saved to cache
2026-03-12 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804
2026-03-12 20:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127891)
2026-03-12 20:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712c110>
2026-03-12 20:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/4.jpeg saved to cache
2026-03-12 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804
2026-03-12 20:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127891)
2026-03-12 20:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66079550>
2026-03-12 20:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/3.jpeg saved to cache
2026-03-12 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804
2026-03-12 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127891)
2026-03-12 20:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aec50>
2026-03-12 20:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/2.jpeg saved to cache
2026-03-12 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804
2026-03-12 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127891)
2026-03-12 20:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6710f910>
2026-03-12 20:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/1.jpeg saved to cache
2026-03-12 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804
2026-03-12 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127891)
2026-03-12 20:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c12c650>
2026-03-12 20:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/0.jpeg saved to cache
2026-03-12 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804
2026-03-12 20:13:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be1bd72a-20e3-5a96-bf9c-934c0f8cd804, skipping ID generation
2026-03-12 20:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804 with scrape type 1
2026-03-12 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be1bd72a-20e3-5a96-bf9c-934c0f8cd804 sending to next pipeline
2026-03-12 20:13:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: be1bd72a-20e3-5a96-bf9c-934c0f8cd804, identifier: 127891
2026-03-12 20:13:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: be1bd72a-20e3-5a96-bf9c-934c0f8cd804 with identifier: 127891
2026-03-12 20:13:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: be1bd72a-20e3-5a96-bf9c-934c0f8cd804 with identifier: 127891
2026-03-12 20:13:20 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: be1bd72a-20e3-5a96-bf9c-934c0f8cd804 with identifier: 127891 to the API
2026-03-12 20:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:13:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:13:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 122,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'be1bd72a-20e3-5a96-bf9c-934c0f8cd804',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YO73CFN',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-focus-hatchback-2021-10-ecoboost-hybrid-mhev-st-line-x-5dr-127891',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'FOCUS HATCHBACK (2021)',
'odometer': 24044,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94417,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83404,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86427,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114974,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97908,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82396,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101011,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110907,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73901,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be1bd72a-20e3-5a96-bf9c-934c0f8cd804/be1bd72a-20e3-5a96-bf9c-934c0f8cd804_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101431,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127891/9.jpeg',
'Width': 800}],
'price': 16200.0,
'price_includes_vat': True,
'registration_date': '2024-02-06',
'seats_number': 5,
'seller_name': None,
'title': 'Ford FOCUS HATCHBACK (2021) 1.0 EcoBoost Hybrid mHEV ST-Line X 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost Hybrid mHEV ST-Line X 5dr',
'vin': 'WF0NXXGCHNPU47096',
'year': 2024}
2026-03-12 20:13:20 [arval.uk] INFO: Saving data for 127891: {'created_time': 1773346400.591043, 'last_price_update_time': 1773346400.591052}
2026-03-12 20:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121092)
2026-03-12 20:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604c790>
2026-03-12 20:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/9.jpeg saved to cache
2026-03-12 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49b41ca5-c207-5ad2-a614-082d8194942b
2026-03-12 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121092)
2026-03-12 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef19d0>
2026-03-12 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/8.jpeg saved to cache
2026-03-12 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49b41ca5-c207-5ad2-a614-082d8194942b
2026-03-12 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124560)
2026-03-12 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16f890>
2026-03-12 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/9.jpeg saved to cache
2026-03-12 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b431f688-82cd-58b3-ab0e-c6776880557d
2026-03-12 20:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124560)
2026-03-12 20:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef0150>
2026-03-12 20:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/8.jpeg saved to cache
2026-03-12 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b431f688-82cd-58b3-ab0e-c6776880557d
2026-03-12 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127326)
2026-03-12 20:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a8050>
2026-03-12 20:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/9.jpeg saved to cache
2026-03-12 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43
2026-03-12 20:13:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127326)
2026-03-12 20:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712ef50>
2026-03-12 20:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/8.jpeg saved to cache
2026-03-12 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43
2026-03-12 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127326)
2026-03-12 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607b990>
2026-03-12 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/7.jpeg saved to cache
2026-03-12 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43
2026-03-12 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127326)
2026-03-12 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b6390>
2026-03-12 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/6.jpeg saved to cache
2026-03-12 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43
2026-03-12 20:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127326)
2026-03-12 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa350>
2026-03-12 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/5.jpeg saved to cache
2026-03-12 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43
2026-03-12 20:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127326)
2026-03-12 20:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606ba10>
2026-03-12 20:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/4.jpeg saved to cache
2026-03-12 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43
2026-03-12 20:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127326)
2026-03-12 20:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677cbf10>
2026-03-12 20:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/3.jpeg saved to cache
2026-03-12 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43
2026-03-12 20:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127326)
2026-03-12 20:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f54d90>
2026-03-12 20:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/2.jpeg saved to cache
2026-03-12 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43
2026-03-12 20:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127326)
2026-03-12 20:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660796d0>
2026-03-12 20:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/1.jpeg saved to cache
2026-03-12 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43
2026-03-12 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127326)
2026-03-12 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f54850>
2026-03-12 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/0.jpeg saved to cache
2026-03-12 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43
2026-03-12 20:13:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43, skipping ID generation
2026-03-12 20:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43 with scrape type 1
2026-03-12 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43 sending to next pipeline
2026-03-12 20:13:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43, identifier: 127326
2026-03-12 20:13:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43 with identifier: 127326
2026-03-12 20:13:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43 with identifier: 127326
2026-03-12 20:13:37 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 94c4ca2f-8bd3-53f9-ab8a-d20839b39e43 with identifier: 127326 to the API
2026-03-12 20:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:13:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 122,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '94c4ca2f-8bd3-53f9-ab8a-d20839b39e43',
'is_damaged': False,
'is_operable': True,
'license_plate': 'FP73DJJ',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-focus-hatchback-2021-10-ecoboost-st-line-5dr-127326',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'FOCUS HATCHBACK (2021)',
'odometer': 17332,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103650,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77862,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104682,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115918,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105717,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92289,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109939,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113424,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78080,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94c4ca2f-8bd3-53f9-ab8a-d20839b39e43/94c4ca2f-8bd3-53f9-ab8a-d20839b39e43_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105286,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127326/9.jpeg',
'Width': 800}],
'price': 15800.0,
'price_includes_vat': True,
'registration_date': '2023-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Ford FOCUS HATCHBACK (2021) 1.0 EcoBoost ST-Line 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost ST-Line 5dr',
'vin': 'WF0NXXGCHNPJ33229',
'year': 2023}
2026-03-12 20:13:37 [arval.uk] INFO: Saving data for 127326: {'created_time': 1773346417.69231, 'last_price_update_time': 1773346417.692321}
2026-03-12 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124560)
2026-03-12 20:13:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c18edd0>
2026-03-12 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/7.jpeg saved to cache
2026-03-12 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b431f688-82cd-58b3-ab0e-c6776880557d
2026-03-12 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124560)
2026-03-12 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123598> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c17b090>
2026-03-12 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/6.jpeg saved to cache
2026-03-12 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b431f688-82cd-58b3-ab0e-c6776880557d
2026-03-12 20:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8335d9a4-c3ad-517d-bd84-b005581ad8de with identifier: 123598
2026-03-12 20:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8335d9a4-c3ad-517d-bd84-b005581ad8de with scrape type 1
2026-03-12 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8335d9a4-c3ad-517d-bd84-b005581ad8de
2026-03-12 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/0.jpeg not downloaded yet
2026-03-12 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/1.jpeg not downloaded yet
2026-03-12 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/2.jpeg not downloaded yet
2026-03-12 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/3.jpeg not downloaded yet
2026-03-12 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/4.jpeg not downloaded yet
2026-03-12 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/5.jpeg not downloaded yet
2026-03-12 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/6.jpeg not downloaded yet
2026-03-12 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/7.jpeg not downloaded yet
2026-03-12 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/8.jpeg not downloaded yet
2026-03-12 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/9.jpeg not downloaded yet
2026-03-12 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124560)
2026-03-12 20:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66082550>
2026-03-12 20:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/5.jpeg saved to cache
2026-03-12 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b431f688-82cd-58b3-ab0e-c6776880557d
2026-03-12 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124560)
2026-03-12 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f56550>
2026-03-12 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/4.jpeg saved to cache
2026-03-12 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b431f688-82cd-58b3-ab0e-c6776880557d
2026-03-12 20:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124560)
2026-03-12 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5d410>
2026-03-12 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/3.jpeg saved to cache
2026-03-12 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b431f688-82cd-58b3-ab0e-c6776880557d
2026-03-12 20:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124560)
2026-03-12 20:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c1474d0>
2026-03-12 20:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/2.jpeg saved to cache
2026-03-12 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b431f688-82cd-58b3-ab0e-c6776880557d
2026-03-12 20:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124560)
2026-03-12 20:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66076550>
2026-03-12 20:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/1.jpeg saved to cache
2026-03-12 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b431f688-82cd-58b3-ab0e-c6776880557d
2026-03-12 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124560)
2026-03-12 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67770590>
2026-03-12 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/0.jpeg saved to cache
2026-03-12 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b431f688-82cd-58b3-ab0e-c6776880557d
2026-03-12 20:13:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b431f688-82cd-58b3-ab0e-c6776880557d, skipping ID generation
2026-03-12 20:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b431f688-82cd-58b3-ab0e-c6776880557d with scrape type 1
2026-03-12 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b431f688-82cd-58b3-ab0e-c6776880557d sending to next pipeline
2026-03-12 20:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: b431f688-82cd-58b3-ab0e-c6776880557d, identifier: 124560
2026-03-12 20:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: b431f688-82cd-58b3-ab0e-c6776880557d with identifier: 124560
2026-03-12 20:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: b431f688-82cd-58b3-ab0e-c6776880557d with identifier: 124560
2026-03-12 20:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: b431f688-82cd-58b3-ab0e-c6776880557d with identifier: 124560 to the API
2026-03-12 20:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:13:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.5L',
'engine_horse_power': 135,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'b431f688-82cd-58b3-ab0e-c6776880557d',
'is_damaged': False,
'is_operable': True,
'license_plate': 'HN23SVZ',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/bmw-2-series-gran-coupe-2020-218i-136-sport-4dr-live-cockpit-professional-124560',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'BMW',
'model': '2 SERIES GRAN COUPE (2020)',
'odometer': 52195,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 47,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39711,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41687,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37325,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30899,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38146,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35423,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41321,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40430,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95487,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b431f688-82cd-58b3-ab0e-c6776880557d/b431f688-82cd-58b3-ab0e-c6776880557d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37824,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124560/9.jpeg',
'Width': 800}],
'price': 15900.0,
'price_includes_vat': True,
'registration_date': '2023-04-16',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 2 SERIES GRAN COUPE (2020) 218i [136] Sport 4dr [Live Cockpit '
'Professional]',
'transmission': 'manual',
'trim': '218i [136] Sport 4dr [Live Cockpit Professional]',
'vin': 'WBA12AK0307M44088',
'year': 2023}
2026-03-12 20:13:48 [arval.uk] INFO: Saving data for 124560: {'created_time': 1773346428.242925, 'last_price_update_time': 1773346428.242938}
2026-03-12 20:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121092)
2026-03-12 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c144390>
2026-03-12 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/7.jpeg saved to cache
2026-03-12 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49b41ca5-c207-5ad2-a614-082d8194942b
2026-03-12 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121092)
2026-03-12 20:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67704d50>
2026-03-12 20:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/6.jpeg saved to cache
2026-03-12 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49b41ca5-c207-5ad2-a614-082d8194942b
2026-03-12 20:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121092)
2026-03-12 20:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660830d0>
2026-03-12 20:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/5.jpeg saved to cache
2026-03-12 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49b41ca5-c207-5ad2-a614-082d8194942b
2026-03-12 20:13:51 [scrapy.extensions.logstats] INFO: Crawled 117 pages (at 4 pages/min), scraped 88 items (at 5 items/min)
2026-03-12 20:13:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121092)
2026-03-12 20:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67771390>
2026-03-12 20:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/4.jpeg saved to cache
2026-03-12 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49b41ca5-c207-5ad2-a614-082d8194942b
2026-03-12 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121092)
2026-03-12 20:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660bb390>
2026-03-12 20:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/3.jpeg saved to cache
2026-03-12 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49b41ca5-c207-5ad2-a614-082d8194942b
2026-03-12 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121092)
2026-03-12 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6771b5d0>
2026-03-12 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/2.jpeg saved to cache
2026-03-12 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49b41ca5-c207-5ad2-a614-082d8194942b
2026-03-12 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121092)
2026-03-12 20:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660adc10>
2026-03-12 20:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/1.jpeg saved to cache
2026-03-12 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49b41ca5-c207-5ad2-a614-082d8194942b
2026-03-12 20:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121092)
2026-03-12 20:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c147f10>
2026-03-12 20:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/0.jpeg saved to cache
2026-03-12 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49b41ca5-c207-5ad2-a614-082d8194942b
2026-03-12 20:13:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49b41ca5-c207-5ad2-a614-082d8194942b, skipping ID generation
2026-03-12 20:13:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49b41ca5-c207-5ad2-a614-082d8194942b with scrape type 1
2026-03-12 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49b41ca5-c207-5ad2-a614-082d8194942b sending to next pipeline
2026-03-12 20:13:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 49b41ca5-c207-5ad2-a614-082d8194942b, identifier: 121092
2026-03-12 20:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 49b41ca5-c207-5ad2-a614-082d8194942b with identifier: 121092
2026-03-12 20:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 49b41ca5-c207-5ad2-a614-082d8194942b with identifier: 121092
2026-03-12 20:13:56 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 49b41ca5-c207-5ad2-a614-082d8194942b with identifier: 121092 to the API
2026-03-12 20:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:13:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:13:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 158,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '49b41ca5-c207-5ad2-a614-082d8194942b',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BT72KFC',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/kia-pro-ceed-shooting-brake-2021-15t-gdi-isg-gt-line-5dr-121092',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Kia',
'model': 'PRO CEED SHOOTING BRAKE (2021)',
'odometer': 18162,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66232,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60449,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52479,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53847,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132723,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68289,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115955,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108244,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96257,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49b41ca5-c207-5ad2-a614-082d8194942b/49b41ca5-c207-5ad2-a614-082d8194942b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88005,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/121092/9.jpeg',
'Width': 1280}],
'price': 16000.0,
'price_includes_vat': True,
'registration_date': '2022-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'Kia PRO CEED SHOOTING BRAKE (2021) 1.5T GDi ISG GT-Line 5dr',
'transmission': 'manual',
'trim': '1.5T GDi ISG GT-Line 5dr',
'vin': 'U5YH2G15LPL063727',
'year': 2022}
2026-03-12 20:13:57 [arval.uk] INFO: Saving data for 121092: {'created_time': 1773346437.138832, 'last_price_update_time': 1773346437.138843}
2026-03-12 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113137)
2026-03-12 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67120a10>
2026-03-12 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/6.jpeg saved to cache
2026-03-12 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78f95676-02ed-5666-b076-efe227a54063
2026-03-12 20:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113137)
2026-03-12 20:13:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66076b50>
2026-03-12 20:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/5.jpeg saved to cache
2026-03-12 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78f95676-02ed-5666-b076-efe227a54063
2026-03-12 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123598)
2026-03-12 20:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66075a10>
2026-03-12 20:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:13:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:13:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/9.jpeg saved to cache
2026-03-12 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8335d9a4-c3ad-517d-bd84-b005581ad8de
2026-03-12 20:14:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119767> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e2761d1-466a-5047-91c4-d96c61c1509e with identifier: 119767
2026-03-12 20:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e2761d1-466a-5047-91c4-d96c61c1509e with scrape type 1
2026-03-12 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e2761d1-466a-5047-91c4-d96c61c1509e
2026-03-12 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/0.jpeg not downloaded yet
2026-03-12 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/1.jpeg not downloaded yet
2026-03-12 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/2.jpeg not downloaded yet
2026-03-12 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/3.jpeg not downloaded yet
2026-03-12 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/4.jpeg not downloaded yet
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/5.jpeg not downloaded yet
2026-03-12 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123598)
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/6.jpeg not downloaded yet
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/7.jpeg not downloaded yet
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/8.jpeg not downloaded yet
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/9.jpeg not downloaded yet
2026-03-12 20:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67615f10>
2026-03-12 20:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/8.jpeg saved to cache
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8335d9a4-c3ad-517d-bd84-b005581ad8de
2026-03-12 20:14:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130269> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:14:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23b1a8bd-caaa-5596-86d4-94840ea109b1 with identifier: 130269
2026-03-12 20:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23b1a8bd-caaa-5596-86d4-94840ea109b1 with scrape type 1
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23b1a8bd-caaa-5596-86d4-94840ea109b1
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/0.jpeg not downloaded yet
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/1.jpeg not downloaded yet
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/2.jpeg not downloaded yet
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/3.jpeg not downloaded yet
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/4.jpeg not downloaded yet
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/5.jpeg not downloaded yet
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/6.jpeg not downloaded yet
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/7.jpeg not downloaded yet
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/8.jpeg not downloaded yet
2026-03-12 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/9.jpeg not downloaded yet
2026-03-12 20:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123598)
2026-03-12 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b7690>
2026-03-12 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/7.jpeg saved to cache
2026-03-12 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8335d9a4-c3ad-517d-bd84-b005581ad8de
2026-03-12 20:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127492> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:14:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e69858a6-1407-5f96-8bd5-7d7076f13a0c with identifier: 127492
2026-03-12 20:14:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e69858a6-1407-5f96-8bd5-7d7076f13a0c with scrape type 1
2026-03-12 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e69858a6-1407-5f96-8bd5-7d7076f13a0c
2026-03-12 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/0.jpeg not downloaded yet
2026-03-12 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/1.jpeg not downloaded yet
2026-03-12 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/2.jpeg not downloaded yet
2026-03-12 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/3.jpeg not downloaded yet
2026-03-12 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/4.jpeg not downloaded yet
2026-03-12 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/5.jpeg not downloaded yet
2026-03-12 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/6.jpeg not downloaded yet
2026-03-12 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/7.jpeg not downloaded yet
2026-03-12 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/8.jpeg not downloaded yet
2026-03-12 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/9.jpeg not downloaded yet
2026-03-12 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123598)
2026-03-12 20:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717a590>
2026-03-12 20:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/6.jpeg saved to cache
2026-03-12 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8335d9a4-c3ad-517d-bd84-b005581ad8de
2026-03-12 20:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123598)
2026-03-12 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c178550>
2026-03-12 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/5.jpeg saved to cache
2026-03-12 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8335d9a4-c3ad-517d-bd84-b005581ad8de
2026-03-12 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123598)
2026-03-12 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67645290>
2026-03-12 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/4.jpeg saved to cache
2026-03-12 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8335d9a4-c3ad-517d-bd84-b005581ad8de
2026-03-12 20:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123598)
2026-03-12 20:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c178c50>
2026-03-12 20:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/3.jpeg saved to cache
2026-03-12 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8335d9a4-c3ad-517d-bd84-b005581ad8de
2026-03-12 20:14:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123598)
2026-03-12 20:14:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67199310>
2026-03-12 20:14:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/2.jpeg saved to cache
2026-03-12 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8335d9a4-c3ad-517d-bd84-b005581ad8de
2026-03-12 20:14:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123598)
2026-03-12 20:14:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67179210>
2026-03-12 20:14:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/1.jpeg saved to cache
2026-03-12 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8335d9a4-c3ad-517d-bd84-b005581ad8de
2026-03-12 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123598)
2026-03-12 20:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16ff10>
2026-03-12 20:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/0.jpeg saved to cache
2026-03-12 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8335d9a4-c3ad-517d-bd84-b005581ad8de
2026-03-12 20:14:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8335d9a4-c3ad-517d-bd84-b005581ad8de, skipping ID generation
2026-03-12 20:14:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8335d9a4-c3ad-517d-bd84-b005581ad8de with scrape type 1
2026-03-12 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8335d9a4-c3ad-517d-bd84-b005581ad8de sending to next pipeline
2026-03-12 20:14:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 8335d9a4-c3ad-517d-bd84-b005581ad8de, identifier: 123598
2026-03-12 20:14:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 8335d9a4-c3ad-517d-bd84-b005581ad8de with identifier: 123598
2026-03-12 20:14:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 8335d9a4-c3ad-517d-bd84-b005581ad8de with identifier: 123598
2026-03-12 20:14:12 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 8335d9a4-c3ad-517d-bd84-b005581ad8de with identifier: 123598 to the API
2026-03-12 20:14:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:14:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Diesel',
'id': '8335d9a4-c3ad-517d-bd84-b005581ad8de',
'is_damaged': False,
'is_operable': True,
'license_plate': 'MJ72FND',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/skoda-karoq-diesel-estate-2022-20-tdi-150-se-drive-5dr-123598',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Skoda',
'model': 'KAROQ DIESEL ESTATE (2022)',
'odometer': 53436,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 38,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42237,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42810,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40972,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36123,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40668,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42087,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42922,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39890,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89846,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8335d9a4-c3ad-517d-bd84-b005581ad8de/8335d9a4-c3ad-517d-bd84-b005581ad8de_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47864,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123598/9.jpeg',
'Width': 800}],
'price': 15800.0,
'price_includes_vat': True,
'registration_date': '2023-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda KAROQ DIESEL ESTATE (2022) 2.0 TDI [150] SE Drive 5dr',
'transmission': 'manual',
'trim': '2.0 TDI [150] SE Drive 5dr',
'vin': 'TMBKJ7NU2P5025635',
'year': 2023}
2026-03-12 20:14:12 [arval.uk] INFO: Saving data for 123598: {'created_time': 1773346452.335224, 'last_price_update_time': 1773346452.335235}
2026-03-12 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113137)
2026-03-12 20:14:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6710f290>
2026-03-12 20:14:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/4.jpeg saved to cache
2026-03-12 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78f95676-02ed-5666-b076-efe227a54063
2026-03-12 20:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113137)
2026-03-12 20:14:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f36310>
2026-03-12 20:14:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/3.jpeg saved to cache
2026-03-12 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78f95676-02ed-5666-b076-efe227a54063
2026-03-12 20:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113137)
2026-03-12 20:14:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a2410>
2026-03-12 20:14:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/2.jpeg saved to cache
2026-03-12 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78f95676-02ed-5666-b076-efe227a54063
2026-03-12 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113137)
2026-03-12 20:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677cb510>
2026-03-12 20:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/1.jpeg saved to cache
2026-03-12 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78f95676-02ed-5666-b076-efe227a54063
2026-03-12 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113137)
2026-03-12 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f7a8a7d90>
2026-03-12 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/0.jpeg saved to cache
2026-03-12 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78f95676-02ed-5666-b076-efe227a54063
2026-03-12 20:14:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78f95676-02ed-5666-b076-efe227a54063, skipping ID generation
2026-03-12 20:14:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78f95676-02ed-5666-b076-efe227a54063 with scrape type 1
2026-03-12 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78f95676-02ed-5666-b076-efe227a54063 sending to next pipeline
2026-03-12 20:14:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 78f95676-02ed-5666-b076-efe227a54063, identifier: 113137
2026-03-12 20:14:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 78f95676-02ed-5666-b076-efe227a54063 with identifier: 113137
2026-03-12 20:14:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 78f95676-02ed-5666-b076-efe227a54063 with identifier: 113137
2026-03-12 20:14:18 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 78f95676-02ed-5666-b076-efe227a54063 with identifier: 113137 to the API
2026-03-12 20:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:14:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:14:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 94,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '78f95676-02ed-5666-b076-efe227a54063',
'is_damaged': False,
'is_operable': True,
'license_plate': 'FH21YCX',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/audi-a1-sportback-2018-25-tfsi-technik-5dr-113137',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Audi',
'model': 'A1 SPORTBACK (2018)',
'odometer': 18779,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 54,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48010,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45865,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56667,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49238,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49275,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39891,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51777,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47774,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61329,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f95676-02ed-5666-b076-efe227a54063/78f95676-02ed-5666-b076-efe227a54063_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31078,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113137/9.jpeg',
'Width': 800}],
'price': 14000.0,
'price_includes_vat': True,
'registration_date': '2021-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A1 SPORTBACK (2018) 25 TFSI Technik 5dr',
'transmission': 'manual',
'trim': '25 TFSI Technik 5dr',
'vin': 'WAUZZZGB2MR065567',
'year': 2021}
2026-03-12 20:14:18 [arval.uk] INFO: Saving data for 113137: {'created_time': 1773346458.899245, 'last_price_update_time': 1773346458.899254}
2026-03-12 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119767)
2026-03-12 20:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67198dd0>
2026-03-12 20:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/5.jpeg saved to cache
2026-03-12 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e2761d1-466a-5047-91c4-d96c61c1509e
2026-03-12 20:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119767)
2026-03-12 20:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67179090>
2026-03-12 20:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/9.jpeg saved to cache
2026-03-12 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e2761d1-466a-5047-91c4-d96c61c1509e
2026-03-12 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130269)
2026-03-12 20:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67612910>
2026-03-12 20:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/9.jpeg saved to cache
2026-03-12 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23b1a8bd-caaa-5596-86d4-94840ea109b1
2026-03-12 20:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130269)
2026-03-12 20:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbf5050>
2026-03-12 20:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/8.jpeg saved to cache
2026-03-12 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23b1a8bd-caaa-5596-86d4-94840ea109b1
2026-03-12 20:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127492)
2026-03-12 20:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c12ee90>
2026-03-12 20:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/9.jpeg saved to cache
2026-03-12 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e69858a6-1407-5f96-8bd5-7d7076f13a0c
2026-03-12 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127492)
2026-03-12 20:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67614850>
2026-03-12 20:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/8.jpeg saved to cache
2026-03-12 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e69858a6-1407-5f96-8bd5-7d7076f13a0c
2026-03-12 20:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127492)
2026-03-12 20:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67121a10>
2026-03-12 20:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/7.jpeg saved to cache
2026-03-12 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e69858a6-1407-5f96-8bd5-7d7076f13a0c
2026-03-12 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127492)
2026-03-12 20:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66050210>
2026-03-12 20:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/6.jpeg saved to cache
2026-03-12 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e69858a6-1407-5f96-8bd5-7d7076f13a0c
2026-03-12 20:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127492)
2026-03-12 20:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604c890>
2026-03-12 20:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/5.jpeg saved to cache
2026-03-12 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e69858a6-1407-5f96-8bd5-7d7076f13a0c
2026-03-12 20:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127492)
2026-03-12 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5c450>
2026-03-12 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/4.jpeg saved to cache
2026-03-12 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e69858a6-1407-5f96-8bd5-7d7076f13a0c
2026-03-12 20:14:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127492)
2026-03-12 20:14:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604f950>
2026-03-12 20:14:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/3.jpeg saved to cache
2026-03-12 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e69858a6-1407-5f96-8bd5-7d7076f13a0c
2026-03-12 20:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127492)
2026-03-12 20:14:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6719aa50>
2026-03-12 20:14:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/2.jpeg saved to cache
2026-03-12 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e69858a6-1407-5f96-8bd5-7d7076f13a0c
2026-03-12 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127492)
2026-03-12 20:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c179110>
2026-03-12 20:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/1.jpeg saved to cache
2026-03-12 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e69858a6-1407-5f96-8bd5-7d7076f13a0c
2026-03-12 20:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127492)
2026-03-12 20:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5cd50>
2026-03-12 20:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/0.jpeg saved to cache
2026-03-12 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e69858a6-1407-5f96-8bd5-7d7076f13a0c
2026-03-12 20:14:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e69858a6-1407-5f96-8bd5-7d7076f13a0c, skipping ID generation
2026-03-12 20:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e69858a6-1407-5f96-8bd5-7d7076f13a0c with scrape type 1
2026-03-12 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e69858a6-1407-5f96-8bd5-7d7076f13a0c sending to next pipeline
2026-03-12 20:14:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: e69858a6-1407-5f96-8bd5-7d7076f13a0c, identifier: 127492
2026-03-12 20:14:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: e69858a6-1407-5f96-8bd5-7d7076f13a0c with identifier: 127492
2026-03-12 20:14:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: e69858a6-1407-5f96-8bd5-7d7076f13a0c with identifier: 127492
2026-03-12 20:14:35 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: e69858a6-1407-5f96-8bd5-7d7076f13a0c with identifier: 127492 to the API
2026-03-12 20:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:14:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:14:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'engine_horse_power': 120,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': 'e69858a6-1407-5f96-8bd5-7d7076f13a0c',
'is_damaged': False,
'is_operable': True,
'license_plate': 'FD71XWU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/toyota-corolla-touring-sport-2018-18-vvt-i-hybrid-icon-tech-5dr-cvt-127492',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Toyota',
'model': 'COROLLA TOURING SPORT (2018)',
'odometer': 71523,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50709,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47381,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50488,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50670,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49539,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40176,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51018,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48045,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40377,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e69858a6-1407-5f96-8bd5-7d7076f13a0c/e69858a6-1407-5f96-8bd5-7d7076f13a0c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69095,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127492/9.jpeg',
'Width': 800}],
'price': 15400.0,
'price_includes_vat': True,
'registration_date': '2022-02-20',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota COROLLA TOURING SPORT (2018) 1.8 VVT-i Hybrid Icon Tech 5dr '
'CVT',
'transmission': 'automatic',
'trim': '1.8 VVT-i Hybrid Icon Tech 5dr CVT',
'vin': 'SB1Z93BE50E287950',
'year': 2022}
2026-03-12 20:14:35 [arval.uk] INFO: Saving data for 127492: {'created_time': 1773346475.996786, 'last_price_update_time': 1773346475.996798}
2026-03-12 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130269)
2026-03-12 20:14:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f7a8a4350>
2026-03-12 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/7.jpeg saved to cache
2026-03-12 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23b1a8bd-caaa-5596-86d4-94840ea109b1
2026-03-12 20:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129353> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:14:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:14:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5407276-a61d-5525-acfc-2c363464092d with identifier: 129353
2026-03-12 20:14:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5407276-a61d-5525-acfc-2c363464092d with scrape type 1
2026-03-12 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5407276-a61d-5525-acfc-2c363464092d
2026-03-12 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/0.jpeg not downloaded yet
2026-03-12 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/1.jpeg not downloaded yet
2026-03-12 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/2.jpeg not downloaded yet
2026-03-12 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/3.jpeg not downloaded yet
2026-03-12 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/4.jpeg not downloaded yet
2026-03-12 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/5.jpeg not downloaded yet
2026-03-12 20:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130269)
2026-03-12 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/6.jpeg not downloaded yet
2026-03-12 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/7.jpeg not downloaded yet
2026-03-12 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/8.jpeg not downloaded yet
2026-03-12 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/9.jpeg not downloaded yet
2026-03-12 20:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717ac10>
2026-03-12 20:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/6.jpeg saved to cache
2026-03-12 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23b1a8bd-caaa-5596-86d4-94840ea109b1
2026-03-12 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130269)
2026-03-12 20:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5ef50>
2026-03-12 20:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/5.jpeg saved to cache
2026-03-12 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23b1a8bd-caaa-5596-86d4-94840ea109b1
2026-03-12 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127067> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:14:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00802ebd-8183-5d5a-a51b-e018c1e20a96 with identifier: 127067
2026-03-12 20:14:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00802ebd-8183-5d5a-a51b-e018c1e20a96 with scrape type 1
2026-03-12 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00802ebd-8183-5d5a-a51b-e018c1e20a96
2026-03-12 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/0.jpeg not downloaded yet
2026-03-12 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/1.jpeg not downloaded yet
2026-03-12 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/2.jpeg not downloaded yet
2026-03-12 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/3.jpeg not downloaded yet
2026-03-12 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/4.jpeg not downloaded yet
2026-03-12 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/5.jpeg not downloaded yet
2026-03-12 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/6.jpeg not downloaded yet
2026-03-12 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/7.jpeg not downloaded yet
2026-03-12 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/8.jpeg not downloaded yet
2026-03-12 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/9.jpeg not downloaded yet
2026-03-12 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130269)
2026-03-12 20:14:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717b1d0>
2026-03-12 20:14:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/4.jpeg saved to cache
2026-03-12 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23b1a8bd-caaa-5596-86d4-94840ea109b1
2026-03-12 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130269)
2026-03-12 20:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766d190>
2026-03-12 20:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/3.jpeg saved to cache
2026-03-12 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23b1a8bd-caaa-5596-86d4-94840ea109b1
2026-03-12 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130269)
2026-03-12 20:14:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712da50>
2026-03-12 20:14:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/2.jpeg saved to cache
2026-03-12 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23b1a8bd-caaa-5596-86d4-94840ea109b1
2026-03-12 20:14:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130269)
2026-03-12 20:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6719b390>
2026-03-12 20:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/1.jpeg saved to cache
2026-03-12 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23b1a8bd-caaa-5596-86d4-94840ea109b1
2026-03-12 20:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/130269)
2026-03-12 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67615a50>
2026-03-12 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/0.jpeg saved to cache
2026-03-12 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23b1a8bd-caaa-5596-86d4-94840ea109b1
2026-03-12 20:14:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23b1a8bd-caaa-5596-86d4-94840ea109b1, skipping ID generation
2026-03-12 20:14:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23b1a8bd-caaa-5596-86d4-94840ea109b1 with scrape type 1
2026-03-12 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23b1a8bd-caaa-5596-86d4-94840ea109b1 sending to next pipeline
2026-03-12 20:14:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 23b1a8bd-caaa-5596-86d4-94840ea109b1, identifier: 130269
2026-03-12 20:14:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 23b1a8bd-caaa-5596-86d4-94840ea109b1 with identifier: 130269
2026-03-12 20:14:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 23b1a8bd-caaa-5596-86d4-94840ea109b1 with identifier: 130269
2026-03-12 20:14:44 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 23b1a8bd-caaa-5596-86d4-94840ea109b1 with identifier: 130269 to the API
2026-03-12 20:14:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:14:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:14:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 139,
'expiration_date': None,
'fuel_type': 'Hybrid',
'id': '23b1a8bd-caaa-5596-86d4-94840ea109b1',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BK72YSP',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-kona-hatchback-2021-16-gdi-hybrid-se-connect-5dr-dct-130269',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Hyundai',
'model': 'KONA HATCHBACK (2021)',
'odometer': 25336,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56219,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49040,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58172,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55674,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58229,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48182,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57800,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53587,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55398,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b1a8bd-caaa-5596-86d4-94840ea109b1/23b1a8bd-caaa-5596-86d4-94840ea109b1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37921,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/130269/9.jpeg',
'Width': 800}],
'price': 15500.0,
'price_includes_vat': True,
'registration_date': '2022-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai KONA HATCHBACK (2021) 1.6 GDi Hybrid SE Connect 5dr DCT',
'transmission': 'automatic',
'trim': '1.6 GDi Hybrid SE Connect 5dr DCT',
'vin': 'KMHK281EVPU108338',
'year': 2022}
2026-03-12 20:14:47 [arval.uk] INFO: Saving data for 130269: {'created_time': 1773346487.157129, 'last_price_update_time': 1773346487.157138}
2026-03-12 20:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119767)
2026-03-12 20:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67146e10>
2026-03-12 20:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/8.jpeg saved to cache
2026-03-12 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e2761d1-466a-5047-91c4-d96c61c1509e
2026-03-12 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119767)
2026-03-12 20:14:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67144350>
2026-03-12 20:14:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/7.jpeg saved to cache
2026-03-12 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e2761d1-466a-5047-91c4-d96c61c1509e
2026-03-12 20:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119767)
2026-03-12 20:14:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f8e50>
2026-03-12 20:14:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/6.jpeg saved to cache
2026-03-12 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e2761d1-466a-5047-91c4-d96c61c1509e
2026-03-12 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119767)
2026-03-12 20:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717b9d0>
2026-03-12 20:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/4.jpeg saved to cache
2026-03-12 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e2761d1-466a-5047-91c4-d96c61c1509e
2026-03-12 20:14:51 [scrapy.extensions.logstats] INFO: Crawled 122 pages (at 5 pages/min), scraped 93 items (at 5 items/min)
2026-03-12 20:14:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119767)
2026-03-12 20:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a47d0>
2026-03-12 20:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/3.jpeg saved to cache
2026-03-12 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e2761d1-466a-5047-91c4-d96c61c1509e
2026-03-12 20:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119767)
2026-03-12 20:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f34c50>
2026-03-12 20:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/2.jpeg saved to cache
2026-03-12 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e2761d1-466a-5047-91c4-d96c61c1509e
2026-03-12 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119767)
2026-03-12 20:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604ed50>
2026-03-12 20:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/1.jpeg saved to cache
2026-03-12 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e2761d1-466a-5047-91c4-d96c61c1509e
2026-03-12 20:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119767)
2026-03-12 20:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16e4d0>
2026-03-12 20:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/0.jpeg saved to cache
2026-03-12 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e2761d1-466a-5047-91c4-d96c61c1509e
2026-03-12 20:14:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e2761d1-466a-5047-91c4-d96c61c1509e, skipping ID generation
2026-03-12 20:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e2761d1-466a-5047-91c4-d96c61c1509e with scrape type 1
2026-03-12 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e2761d1-466a-5047-91c4-d96c61c1509e sending to next pipeline
2026-03-12 20:14:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 7e2761d1-466a-5047-91c4-d96c61c1509e, identifier: 119767
2026-03-12 20:14:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 7e2761d1-466a-5047-91c4-d96c61c1509e with identifier: 119767
2026-03-12 20:14:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 20:14:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 7e2761d1-466a-5047-91c4-d96c61c1509e with identifier: 119767
2026-03-12 20:14:55 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 7e2761d1-466a-5047-91c4-d96c61c1509e with identifier: 119767 to the API
2026-03-12 20:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:14:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:14:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 139,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': '7e2761d1-466a-5047-91c4-d96c61c1509e',
'is_damaged': False,
'is_operable': True,
'license_plate': 'NG22DKN',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/kia-xceed-hatchback-2019-16-gdi-phev-4-5dr-dct-119767',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Kia',
'model': 'XCEED HATCHBACK (2019)',
'odometer': 30461,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54456,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48565,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53885,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53414,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45958,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51603,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51667,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43106,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67011,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2761d1-466a-5047-91c4-d96c61c1509e/7e2761d1-466a-5047-91c4-d96c61c1509e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74581,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119767/9.jpeg',
'Width': 800}],
'price': 15800.0,
'price_includes_vat': True,
'registration_date': '2022-08-04',
'seats_number': 5,
'seller_name': None,
'title': 'Kia XCEED HATCHBACK (2019) 1.6 GDi PHEV 4 5dr DCT',
'transmission': 'automatic',
'trim': '1.6 GDi PHEV 4 5dr DCT',
'vin': 'U5YH5F1AVNL032271',
'year': 2022}
2026-03-12 20:14:56 [arval.uk] INFO: Saving data for 119767: {'created_time': 1773346496.068074, 'last_price_update_time': 1773346496.068085}
2026-03-12 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129353)
2026-03-12 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676470d0>
2026-03-12 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/5.jpeg saved to cache
2026-03-12 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5407276-a61d-5525-acfc-2c363464092d
2026-03-12 20:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129353)
2026-03-12 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16d450>
2026-03-12 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/9.jpeg saved to cache
2026-03-12 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5407276-a61d-5525-acfc-2c363464092d
2026-03-12 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129353)
2026-03-12 20:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67610ed0>
2026-03-12 20:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/8.jpeg saved to cache
2026-03-12 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5407276-a61d-5525-acfc-2c363464092d
2026-03-12 20:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127067)
2026-03-12 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f34c10>
2026-03-12 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/9.jpeg saved to cache
2026-03-12 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00802ebd-8183-5d5a-a51b-e018c1e20a96
2026-03-12 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127067)
2026-03-12 20:15:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67750d90>
2026-03-12 20:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/8.jpeg saved to cache
2026-03-12 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00802ebd-8183-5d5a-a51b-e018c1e20a96
2026-03-12 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127067)
2026-03-12 20:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b5150>
2026-03-12 20:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/7.jpeg saved to cache
2026-03-12 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00802ebd-8183-5d5a-a51b-e018c1e20a96
2026-03-12 20:15:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116915> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:15:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c1a0912-8c38-5465-af3a-5afa7687f9ca with identifier: 116915
2026-03-12 20:15:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca with scrape type 1
2026-03-12 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca
2026-03-12 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/0.jpeg not downloaded yet
2026-03-12 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/1.jpeg not downloaded yet
2026-03-12 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/2.jpeg not downloaded yet
2026-03-12 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/3.jpeg not downloaded yet
2026-03-12 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/4.jpeg not downloaded yet
2026-03-12 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/5.jpeg not downloaded yet
2026-03-12 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/6.jpeg not downloaded yet
2026-03-12 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/7.jpeg not downloaded yet
2026-03-12 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/8.jpeg not downloaded yet
2026-03-12 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/9.jpeg not downloaded yet
2026-03-12 20:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127067)
2026-03-12 20:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67613dd0>
2026-03-12 20:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/6.jpeg saved to cache
2026-03-12 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00802ebd-8183-5d5a-a51b-e018c1e20a96
2026-03-12 20:15:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128882> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:15:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1608b8e-685c-576a-a9d2-e8fae7ca4b02 with identifier: 128882
2026-03-12 20:15:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02 with scrape type 1
2026-03-12 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02
2026-03-12 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/0.jpeg not downloaded yet
2026-03-12 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/1.jpeg not downloaded yet
2026-03-12 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/2.jpeg not downloaded yet
2026-03-12 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/3.jpeg not downloaded yet
2026-03-12 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/4.jpeg not downloaded yet
2026-03-12 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/5.jpeg not downloaded yet
2026-03-12 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/6.jpeg not downloaded yet
2026-03-12 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/7.jpeg not downloaded yet
2026-03-12 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/8.jpeg not downloaded yet
2026-03-12 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/9.jpeg not downloaded yet
2026-03-12 20:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127067)
2026-03-12 20:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66079150>
2026-03-12 20:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/5.jpeg saved to cache
2026-03-12 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00802ebd-8183-5d5a-a51b-e018c1e20a96
2026-03-12 20:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121919> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:15:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b with identifier: 121919
2026-03-12 20:15:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b with scrape type 1
2026-03-12 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b
2026-03-12 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/0.jpeg not downloaded yet
2026-03-12 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/1.jpeg not downloaded yet
2026-03-12 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/2.jpeg not downloaded yet
2026-03-12 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/3.jpeg not downloaded yet
2026-03-12 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/4.jpeg not downloaded yet
2026-03-12 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/5.jpeg not downloaded yet
2026-03-12 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/6.jpeg not downloaded yet
2026-03-12 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/7.jpeg not downloaded yet
2026-03-12 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/8.jpeg not downloaded yet
2026-03-12 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/9.jpeg not downloaded yet
2026-03-12 20:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127067)
2026-03-12 20:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66052950>
2026-03-12 20:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/4.jpeg saved to cache
2026-03-12 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00802ebd-8183-5d5a-a51b-e018c1e20a96
2026-03-12 20:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127067)
2026-03-12 20:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6710f290>
2026-03-12 20:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/3.jpeg saved to cache
2026-03-12 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00802ebd-8183-5d5a-a51b-e018c1e20a96
2026-03-12 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127067)
2026-03-12 20:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67750190>
2026-03-12 20:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/2.jpeg saved to cache
2026-03-12 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00802ebd-8183-5d5a-a51b-e018c1e20a96
2026-03-12 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127067)
2026-03-12 20:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713bf90>
2026-03-12 20:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/1.jpeg saved to cache
2026-03-12 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00802ebd-8183-5d5a-a51b-e018c1e20a96
2026-03-12 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127067)
2026-03-12 20:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67179150>
2026-03-12 20:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/0.jpeg saved to cache
2026-03-12 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00802ebd-8183-5d5a-a51b-e018c1e20a96
2026-03-12 20:15:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00802ebd-8183-5d5a-a51b-e018c1e20a96, skipping ID generation
2026-03-12 20:15:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00802ebd-8183-5d5a-a51b-e018c1e20a96 with scrape type 1
2026-03-12 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00802ebd-8183-5d5a-a51b-e018c1e20a96 sending to next pipeline
2026-03-12 20:15:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 00802ebd-8183-5d5a-a51b-e018c1e20a96, identifier: 127067
2026-03-12 20:15:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 00802ebd-8183-5d5a-a51b-e018c1e20a96 with identifier: 127067
2026-03-12 20:15:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 00802ebd-8183-5d5a-a51b-e018c1e20a96 with identifier: 127067
2026-03-12 20:15:11 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 00802ebd-8183-5d5a-a51b-e018c1e20a96 with identifier: 127067 to the API
2026-03-12 20:15:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:15:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:15:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 122,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '00802ebd-8183-5d5a-a51b-e018c1e20a96',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DL72MSO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-puma-hatchback-2019-10-ecoboost-hybrid-mhev-155-st-line-x-5dr-127067',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'PUMA HATCHBACK (2019)',
'odometer': 14357,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87551,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96404,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94551,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73868,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106692,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96416,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89249,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76129,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57357,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00802ebd-8183-5d5a-a51b-e018c1e20a96/00802ebd-8183-5d5a-a51b-e018c1e20a96_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88475,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127067/9.jpeg',
'Width': 800}],
'price': 15300.0,
'price_includes_vat': True,
'registration_date': '2023-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'Ford PUMA HATCHBACK (2019) 1.0 EcoBoost Hybrid mHEV 155 ST-Line X '
'5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost Hybrid mHEV 155 ST-Line X 5dr',
'vin': 'WF02XXERK2NB02544',
'year': 2023}
2026-03-12 20:15:12 [arval.uk] INFO: Saving data for 127067: {'created_time': 1773346512.6662, 'last_price_update_time': 1773346512.666209}
2026-03-12 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129353)
2026-03-12 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cfa5b10>
2026-03-12 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/7.jpeg saved to cache
2026-03-12 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5407276-a61d-5525-acfc-2c363464092d
2026-03-12 20:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129353)
2026-03-12 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67638290>
2026-03-12 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/6.jpeg saved to cache
2026-03-12 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5407276-a61d-5525-acfc-2c363464092d
2026-03-12 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129353)
2026-03-12 20:15:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67646450>
2026-03-12 20:15:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/4.jpeg saved to cache
2026-03-12 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5407276-a61d-5525-acfc-2c363464092d
2026-03-12 20:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129353)
2026-03-12 20:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a5090>
2026-03-12 20:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/3.jpeg saved to cache
2026-03-12 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5407276-a61d-5525-acfc-2c363464092d
2026-03-12 20:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129353)
2026-03-12 20:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f9290>
2026-03-12 20:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/2.jpeg saved to cache
2026-03-12 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5407276-a61d-5525-acfc-2c363464092d
2026-03-12 20:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129353)
2026-03-12 20:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713a510>
2026-03-12 20:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/1.jpeg saved to cache
2026-03-12 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5407276-a61d-5525-acfc-2c363464092d
2026-03-12 20:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/129353)
2026-03-12 20:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67647b50>
2026-03-12 20:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/0.jpeg saved to cache
2026-03-12 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5407276-a61d-5525-acfc-2c363464092d
2026-03-12 20:15:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5407276-a61d-5525-acfc-2c363464092d, skipping ID generation
2026-03-12 20:15:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5407276-a61d-5525-acfc-2c363464092d with scrape type 1
2026-03-12 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5407276-a61d-5525-acfc-2c363464092d sending to next pipeline
2026-03-12 20:15:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: c5407276-a61d-5525-acfc-2c363464092d, identifier: 129353
2026-03-12 20:15:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: c5407276-a61d-5525-acfc-2c363464092d with identifier: 129353
2026-03-12 20:15:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: c5407276-a61d-5525-acfc-2c363464092d with identifier: 129353
2026-03-12 20:15:21 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: c5407276-a61d-5525-acfc-2c363464092d with identifier: 129353 to the API
2026-03-12 20:15:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:15:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 128,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'c5407276-a61d-5525-acfc-2c363464092d',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DS73YFU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/vauxhall-corsa-hatchback-2023-12-turbo-130-ultimate-5dr-auto-129353',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Vauxhall',
'model': 'CORSA HATCHBACK (2023)',
'odometer': 13743,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55663,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47881,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57763,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55080,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57157,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48435,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60060,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54400,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64405,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5407276-a61d-5525-acfc-2c363464092d/c5407276-a61d-5525-acfc-2c363464092d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75957,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/129353/9.jpeg',
'Width': 800}],
'price': 15300.0,
'price_includes_vat': True,
'registration_date': '2023-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall CORSA HATCHBACK (2023) 1.2 Turbo 130 Ultimate 5dr Auto',
'transmission': 'automatic',
'trim': '1.2 Turbo 130 Ultimate 5dr Auto',
'vin': 'VXKUPHNSSP4288568',
'year': 2023}
2026-03-12 20:15:22 [arval.uk] INFO: Saving data for 129353: {'created_time': 1773346522.132459, 'last_price_update_time': 1773346522.13247}
2026-03-12 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116915)
2026-03-12 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712f850>
2026-03-12 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/9.jpeg saved to cache
2026-03-12 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca
2026-03-12 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116915)
2026-03-12 20:15:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67122150>
2026-03-12 20:15:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/8.jpeg saved to cache
2026-03-12 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca
2026-03-12 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128882)
2026-03-12 20:15:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67179690>
2026-03-12 20:15:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/9.jpeg saved to cache
2026-03-12 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02
2026-03-12 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128882)
2026-03-12 20:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f671238d0>
2026-03-12 20:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/8.jpeg saved to cache
2026-03-12 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02
2026-03-12 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121919)
2026-03-12 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67638fd0>
2026-03-12 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/9.jpeg saved to cache
2026-03-12 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b
2026-03-12 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121919)
2026-03-12 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c12f610>
2026-03-12 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/8.jpeg saved to cache
2026-03-12 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b
2026-03-12 20:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121919)
2026-03-12 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763b250>
2026-03-12 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/7.jpeg saved to cache
2026-03-12 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b
2026-03-12 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121919)
2026-03-12 20:15:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67123210>
2026-03-12 20:15:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/6.jpeg saved to cache
2026-03-12 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b
2026-03-12 20:15:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121919)
2026-03-12 20:15:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66052b10>
2026-03-12 20:15:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/5.jpeg saved to cache
2026-03-12 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b
2026-03-12 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121919)
2026-03-12 20:15:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c12f890>
2026-03-12 20:15:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/4.jpeg saved to cache
2026-03-12 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b
2026-03-12 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121919)
2026-03-12 20:15:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b5490>
2026-03-12 20:15:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/3.jpeg saved to cache
2026-03-12 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b
2026-03-12 20:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121919)
2026-03-12 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67706110>
2026-03-12 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/2.jpeg saved to cache
2026-03-12 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b
2026-03-12 20:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121919)
2026-03-12 20:15:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718d750>
2026-03-12 20:15:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/1.jpeg saved to cache
2026-03-12 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b
2026-03-12 20:15:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121919)
2026-03-12 20:15:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67705ed0>
2026-03-12 20:15:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/0.jpeg saved to cache
2026-03-12 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b
2026-03-12 20:15:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b, skipping ID generation
2026-03-12 20:15:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b with scrape type 1
2026-03-12 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b sending to next pipeline
2026-03-12 20:15:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b, identifier: 121919
2026-03-12 20:15:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b with identifier: 121919
2026-03-12 20:15:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b with identifier: 121919
2026-03-12 20:15:38 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 94b9fbd0-f840-5e9d-bcc4-30f02ef5168b with identifier: 121919 to the API
2026-03-12 20:15:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:15:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:15:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 201,
'expiration_date': None,
'fuel_type': 'Electric',
'id': '94b9fbd0-f840-5e9d-bcc4-30f02ef5168b',
'is_damaged': False,
'is_operable': True,
'license_plate': 'EJ22TJU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-id3-hatchback-2020-150kw-family-pro-perform-58kwh-5dr-auto-120kw-ch-121919',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'ID.3 HATCHBACK (2020)',
'odometer': 31703,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 49,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84592,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77999,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81344,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66240,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46156,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76343,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75911,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63164,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 14493,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_94b9fbd0-f840-5e9d-bcc4-30f02ef5168b/94b9fbd0-f840-5e9d-bcc4-30f02ef5168b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45830,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121919/9.jpeg',
'Width': 800}],
'price': 14700.0,
'price_includes_vat': True,
'registration_date': '2022-07-18',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen ID.3 HATCHBACK (2020) 150kW Family Pro Perform 58kWh 5dr '
'Auto [120kW Ch]',
'transmission': 'automatic',
'trim': '150kW Family Pro Perform 58kWh 5dr Auto [120kW Ch]',
'vin': 'WVWZZZE1ZNP033979',
'year': 2022}
2026-03-12 20:15:38 [arval.uk] INFO: Saving data for 121919: {'created_time': 1773346538.421836, 'last_price_update_time': 1773346538.421846}
2026-03-12 20:15:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128882)
2026-03-12 20:15:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:15:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67638c90>
2026-03-12 20:15:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/7.jpeg saved to cache
2026-03-12 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02
2026-03-12 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128882)
2026-03-12 20:15:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:15:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66068e90>
2026-03-12 20:15:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/6.jpeg saved to cache
2026-03-12 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02
2026-03-12 20:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119109> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:15:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8673390-97f5-5b92-a07d-ba7762e2d8c9 with identifier: 119109
2026-03-12 20:15:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8673390-97f5-5b92-a07d-ba7762e2d8c9 with scrape type 1
2026-03-12 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8673390-97f5-5b92-a07d-ba7762e2d8c9
2026-03-12 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/0.jpeg not downloaded yet
2026-03-12 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/1.jpeg not downloaded yet
2026-03-12 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/2.jpeg not downloaded yet
2026-03-12 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/3.jpeg not downloaded yet
2026-03-12 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/4.jpeg not downloaded yet
2026-03-12 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/5.jpeg not downloaded yet
2026-03-12 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/6.jpeg not downloaded yet
2026-03-12 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/7.jpeg not downloaded yet
2026-03-12 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/8.jpeg not downloaded yet
2026-03-12 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/9.jpeg not downloaded yet
2026-03-12 20:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128882)
2026-03-12 20:15:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67647150>
2026-03-12 20:15:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/5.jpeg saved to cache
2026-03-12 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02
2026-03-12 20:15:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128882)
2026-03-12 20:15:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713abd0>
2026-03-12 20:15:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/4.jpeg saved to cache
2026-03-12 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02
2026-03-12 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128779> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:15:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41cf411c-74c2-5440-af26-37091720e38d with identifier: 128779
2026-03-12 20:15:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41cf411c-74c2-5440-af26-37091720e38d with scrape type 1
2026-03-12 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41cf411c-74c2-5440-af26-37091720e38d
2026-03-12 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/0.jpeg not downloaded yet
2026-03-12 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/1.jpeg not downloaded yet
2026-03-12 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/2.jpeg not downloaded yet
2026-03-12 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/3.jpeg not downloaded yet
2026-03-12 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/4.jpeg not downloaded yet
2026-03-12 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/5.jpeg not downloaded yet
2026-03-12 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/6.jpeg not downloaded yet
2026-03-12 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/7.jpeg not downloaded yet
2026-03-12 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/8.jpeg not downloaded yet
2026-03-12 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/9.jpeg not downloaded yet
2026-03-12 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124141> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:15:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb with identifier: 124141
2026-03-12 20:15:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb with scrape type 1
2026-03-12 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb
2026-03-12 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/0.jpeg not downloaded yet
2026-03-12 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/1.jpeg not downloaded yet
2026-03-12 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/2.jpeg not downloaded yet
2026-03-12 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/3.jpeg not downloaded yet
2026-03-12 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/4.jpeg not downloaded yet
2026-03-12 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/5.jpeg not downloaded yet
2026-03-12 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/6.jpeg not downloaded yet
2026-03-12 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/7.jpeg not downloaded yet
2026-03-12 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/8.jpeg not downloaded yet
2026-03-12 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/9.jpeg not downloaded yet
2026-03-12 20:15:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128882)
2026-03-12 20:15:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766c650>
2026-03-12 20:15:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/3.jpeg saved to cache
2026-03-12 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02
2026-03-12 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128882)
2026-03-12 20:15:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677072d0>
2026-03-12 20:15:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/2.jpeg saved to cache
2026-03-12 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02
2026-03-12 20:15:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128882)
2026-03-12 20:15:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6773a750>
2026-03-12 20:15:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/1.jpeg saved to cache
2026-03-12 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02
2026-03-12 20:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128882)
2026-03-12 20:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b4c50>
2026-03-12 20:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/0.jpeg saved to cache
2026-03-12 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02
2026-03-12 20:15:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1608b8e-685c-576a-a9d2-e8fae7ca4b02, skipping ID generation
2026-03-12 20:15:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02 with scrape type 1
2026-03-12 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1608b8e-685c-576a-a9d2-e8fae7ca4b02 sending to next pipeline
2026-03-12 20:15:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: b1608b8e-685c-576a-a9d2-e8fae7ca4b02, identifier: 128882
2026-03-12 20:15:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: b1608b8e-685c-576a-a9d2-e8fae7ca4b02 with identifier: 128882
2026-03-12 20:15:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: b1608b8e-685c-576a-a9d2-e8fae7ca4b02 with identifier: 128882
2026-03-12 20:15:47 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: b1608b8e-685c-576a-a9d2-e8fae7ca4b02 with identifier: 128882 to the API
2026-03-12 20:15:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:15:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:15:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 129,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'b1608b8e-685c-576a-a9d2-e8fae7ca4b02',
'is_damaged': False,
'is_operable': True,
'license_plate': 'AK72TPO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/peugeot-2008-estate-2019-12-puretech-130-gt-5dr-128882',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Peugeot',
'model': '2008 ESTATE (2019)',
'odometer': 23805,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59949,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55575,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62224,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59839,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57322,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44846,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58719,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56098,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40957,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1608b8e-685c-576a-a9d2-e8fae7ca4b02/b1608b8e-685c-576a-a9d2-e8fae7ca4b02_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82926,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128882/9.jpeg',
'Width': 800}],
'price': 14800.0,
'price_includes_vat': True,
'registration_date': '2023-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 ESTATE (2019) 1.2 PureTech 130 GT 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech 130 GT 5dr',
'vin': 'VR3USHNSKNJ827692',
'year': 2023}
2026-03-12 20:15:47 [arval.uk] INFO: Saving data for 128882: {'created_time': 1773346547.437191, 'last_price_update_time': 1773346547.4372}
2026-03-12 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116915)
2026-03-12 20:15:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607b5d0>
2026-03-12 20:15:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/7.jpeg saved to cache
2026-03-12 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca
2026-03-12 20:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116915)
2026-03-12 20:15:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedba90>
2026-03-12 20:15:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/6.jpeg saved to cache
2026-03-12 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca
2026-03-12 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116915)
2026-03-12 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766e710>
2026-03-12 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/5.jpeg saved to cache
2026-03-12 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca
2026-03-12 20:15:51 [scrapy.extensions.logstats] INFO: Crawled 128 pages (at 6 pages/min), scraped 98 items (at 5 items/min)
2026-03-12 20:15:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116915)
2026-03-12 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0dc890>
2026-03-12 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/4.jpeg saved to cache
2026-03-12 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca
2026-03-12 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116915)
2026-03-12 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a3b10>
2026-03-12 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/3.jpeg saved to cache
2026-03-12 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca
2026-03-12 20:15:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116915)
2026-03-12 20:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677726d0>
2026-03-12 20:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/2.jpeg saved to cache
2026-03-12 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca
2026-03-12 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116915)
2026-03-12 20:15:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718d910>
2026-03-12 20:15:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/1.jpeg saved to cache
2026-03-12 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca
2026-03-12 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116915)
2026-03-12 20:15:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67138ad0>
2026-03-12 20:15:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/0.jpeg saved to cache
2026-03-12 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca
2026-03-12 20:15:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c1a0912-8c38-5465-af3a-5afa7687f9ca, skipping ID generation
2026-03-12 20:15:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca with scrape type 1
2026-03-12 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c1a0912-8c38-5465-af3a-5afa7687f9ca sending to next pipeline
2026-03-12 20:15:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 5c1a0912-8c38-5465-af3a-5afa7687f9ca, identifier: 116915
2026-03-12 20:15:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 5c1a0912-8c38-5465-af3a-5afa7687f9ca with identifier: 116915
2026-03-12 20:15:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 5c1a0912-8c38-5465-af3a-5afa7687f9ca with identifier: 116915
2026-03-12 20:15:57 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 5c1a0912-8c38-5465-af3a-5afa7687f9ca with identifier: 116915 to the API
2026-03-12 20:15:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:15:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:15:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 177,
'expiration_date': None,
'fuel_type': 'Electric',
'id': '5c1a0912-8c38-5465-af3a-5afa7687f9ca',
'is_damaged': False,
'is_operable': True,
'license_plate': 'WU71HVF',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/skoda-enyaq-iv-estate-2021-132kw-60-suite-nav-62kwh-5dr-auto-116915',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Skoda',
'model': 'ENYAQ IV ESTATE (2021)',
'odometer': 33014,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62409,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63694,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64384,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50605,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51908,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163494,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51019,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86759,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96854,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c1a0912-8c38-5465-af3a-5afa7687f9ca/5c1a0912-8c38-5465-af3a-5afa7687f9ca_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91339,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/116915/9.jpeg',
'Width': 1280}],
'price': 14900.0,
'price_includes_vat': True,
'registration_date': '2021-09-08',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda ENYAQ IV ESTATE (2021) 132kW 60 Suite Nav 62kWh 5dr Auto',
'transmission': 'automatic',
'trim': '132kW 60 Suite Nav 62kWh 5dr Auto',
'vin': 'TMBKB7NY3NF009922',
'year': 2021}
2026-03-12 20:15:57 [arval.uk] INFO: Saving data for 116915: {'created_time': 1773346557.340024, 'last_price_update_time': 1773346557.340034}
2026-03-12 20:15:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119109)
2026-03-12 20:15:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cfb82d0>
2026-03-12 20:15:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/9.jpeg saved to cache
2026-03-12 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8673390-97f5-5b92-a07d-ba7762e2d8c9
2026-03-12 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119109)
2026-03-12 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f671381d0>
2026-03-12 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:15:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:15:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/8.jpeg saved to cache
2026-03-12 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8673390-97f5-5b92-a07d-ba7762e2d8c9
2026-03-12 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119109)
2026-03-12 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677cbb50>
2026-03-12 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/7.jpeg saved to cache
2026-03-12 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8673390-97f5-5b92-a07d-ba7762e2d8c9
2026-03-12 20:16:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128779)
2026-03-12 20:16:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67139450>
2026-03-12 20:16:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/9.jpeg saved to cache
2026-03-12 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41cf411c-74c2-5440-af26-37091720e38d
2026-03-12 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124141)
2026-03-12 20:16:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6771a2d0>
2026-03-12 20:16:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/9.jpeg saved to cache
2026-03-12 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb
2026-03-12 20:16:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124141)
2026-03-12 20:16:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713b650>
2026-03-12 20:16:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/8.jpeg saved to cache
2026-03-12 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb
2026-03-12 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124141)
2026-03-12 20:16:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778e210>
2026-03-12 20:16:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/7.jpeg saved to cache
2026-03-12 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb
2026-03-12 20:16:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124141)
2026-03-12 20:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16d150>
2026-03-12 20:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/6.jpeg saved to cache
2026-03-12 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb
2026-03-12 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124141)
2026-03-12 20:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607a750>
2026-03-12 20:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/5.jpeg saved to cache
2026-03-12 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb
2026-03-12 20:16:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124141)
2026-03-12 20:16:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee0550>
2026-03-12 20:16:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/4.jpeg saved to cache
2026-03-12 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb
2026-03-12 20:16:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124141)
2026-03-12 20:16:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660abe10>
2026-03-12 20:16:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/3.jpeg saved to cache
2026-03-12 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb
2026-03-12 20:16:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124141)
2026-03-12 20:16:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67615810>
2026-03-12 20:16:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/2.jpeg saved to cache
2026-03-12 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb
2026-03-12 20:16:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124141)
2026-03-12 20:16:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66052d90>
2026-03-12 20:16:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/1.jpeg saved to cache
2026-03-12 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb
2026-03-12 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124141)
2026-03-12 20:16:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67706150>
2026-03-12 20:16:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/0.jpeg saved to cache
2026-03-12 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb
2026-03-12 20:16:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb, skipping ID generation
2026-03-12 20:16:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb with scrape type 1
2026-03-12 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb sending to next pipeline
2026-03-12 20:16:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb, identifier: 124141
2026-03-12 20:16:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb with identifier: 124141
2026-03-12 20:16:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb with identifier: 124141
2026-03-12 20:16:13 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb with identifier: 124141 to the API
2026-03-12 20:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:16:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:16:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 94,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb',
'is_damaged': False,
'is_operable': True,
'license_plate': 'HF73WUP',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/volkswagen-polo-hatchback-2021-10-tsi-life-5dr-124141',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Volkswagen',
'model': 'POLO HATCHBACK (2021)',
'odometer': 25230,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75155,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70959,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82498,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64962,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48307,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87067,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81617,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60112,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 13128,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb/5a91b484-8ac0-50dc-a1fe-b74e4f2aefbb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37301,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124141/9.jpeg',
'Width': 800}],
'price': 14600.0,
'price_includes_vat': True,
'registration_date': '2023-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen POLO HATCHBACK (2021) 1.0 TSI Life 5dr',
'transmission': 'manual',
'trim': '1.0 TSI Life 5dr',
'vin': 'WVWZZZAWZPU094351',
'year': 2023}
2026-03-12 20:16:14 [arval.uk] INFO: Saving data for 124141: {'created_time': 1773346574.204492, 'last_price_update_time': 1773346574.204504}
2026-03-12 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128779)
2026-03-12 20:16:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:16:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67123d90>
2026-03-12 20:16:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/8.jpeg saved to cache
2026-03-12 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41cf411c-74c2-5440-af26-37091720e38d
2026-03-12 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128779)
2026-03-12 20:16:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f46b10>
2026-03-12 20:16:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/7.jpeg saved to cache
2026-03-12 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41cf411c-74c2-5440-af26-37091720e38d
2026-03-12 20:16:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116799> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:16:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1824cec7-b606-5f08-b5fe-a73724181fa8 with identifier: 116799
2026-03-12 20:16:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1824cec7-b606-5f08-b5fe-a73724181fa8 with scrape type 1
2026-03-12 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1824cec7-b606-5f08-b5fe-a73724181fa8
2026-03-12 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/0.jpeg not downloaded yet
2026-03-12 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/1.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/2.jpeg not downloaded yet
2026-03-12 20:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128779)
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/3.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/4.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/5.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/6.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/7.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/8.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/9.jpeg not downloaded yet
2026-03-12 20:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67120650>
2026-03-12 20:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/6.jpeg saved to cache
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41cf411c-74c2-5440-af26-37091720e38d
2026-03-12 20:16:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124007> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:16:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98c0f89a-a99d-580d-b217-50c33bd2129e with identifier: 124007
2026-03-12 20:16:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98c0f89a-a99d-580d-b217-50c33bd2129e with scrape type 1
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98c0f89a-a99d-580d-b217-50c33bd2129e
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/0.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/1.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/2.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/3.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/4.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/5.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/6.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/7.jpeg not downloaded yet
2026-03-12 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/8.jpeg not downloaded yet
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/9.jpeg not downloaded yet
2026-03-12 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128779)
2026-03-12 20:16:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660af390>
2026-03-12 20:16:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/5.jpeg saved to cache
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41cf411c-74c2-5440-af26-37091720e38d
2026-03-12 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123998> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:16:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b021d16-516c-5313-afb3-a8f22fcfbec4 with identifier: 123998
2026-03-12 20:16:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b021d16-516c-5313-afb3-a8f22fcfbec4 with scrape type 1
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b021d16-516c-5313-afb3-a8f22fcfbec4
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/0.jpeg not downloaded yet
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/1.jpeg not downloaded yet
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/2.jpeg not downloaded yet
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/3.jpeg not downloaded yet
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/4.jpeg not downloaded yet
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/5.jpeg not downloaded yet
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/6.jpeg not downloaded yet
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/7.jpeg not downloaded yet
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/8.jpeg not downloaded yet
2026-03-12 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/9.jpeg not downloaded yet
2026-03-12 20:16:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128779)
2026-03-12 20:16:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5ead0>
2026-03-12 20:16:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/4.jpeg saved to cache
2026-03-12 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41cf411c-74c2-5440-af26-37091720e38d
2026-03-12 20:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128779)
2026-03-12 20:16:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67752350>
2026-03-12 20:16:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/3.jpeg saved to cache
2026-03-12 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41cf411c-74c2-5440-af26-37091720e38d
2026-03-12 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128779)
2026-03-12 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766ee10>
2026-03-12 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/2.jpeg saved to cache
2026-03-12 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41cf411c-74c2-5440-af26-37091720e38d
2026-03-12 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128779)
2026-03-12 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa6d0>
2026-03-12 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/1.jpeg saved to cache
2026-03-12 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41cf411c-74c2-5440-af26-37091720e38d
2026-03-12 20:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128779)
2026-03-12 20:16:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7aad0>
2026-03-12 20:16:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/0.jpeg saved to cache
2026-03-12 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41cf411c-74c2-5440-af26-37091720e38d
2026-03-12 20:16:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41cf411c-74c2-5440-af26-37091720e38d, skipping ID generation
2026-03-12 20:16:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41cf411c-74c2-5440-af26-37091720e38d with scrape type 1
2026-03-12 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41cf411c-74c2-5440-af26-37091720e38d sending to next pipeline
2026-03-12 20:16:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 41cf411c-74c2-5440-af26-37091720e38d, identifier: 128779
2026-03-12 20:16:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 41cf411c-74c2-5440-af26-37091720e38d with identifier: 128779
2026-03-12 20:16:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 41cf411c-74c2-5440-af26-37091720e38d with identifier: 128779
2026-03-12 20:16:23 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 41cf411c-74c2-5440-af26-37091720e38d with identifier: 128779 to the API
2026-03-12 20:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:16:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:16:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 99,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '41cf411c-74c2-5440-af26-37091720e38d',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YM72DFL',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-fiesta-hatchback-2021-10-ecoboost-st-line-x-5dr-128779',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'FIESTA HATCHBACK (2021)',
'odometer': 11529,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80197,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80959,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86996,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91319,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98303,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96152,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78357,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90885,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77440,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41cf411c-74c2-5440-af26-37091720e38d/41cf411c-74c2-5440-af26-37091720e38d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60577,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128779/9.jpeg',
'Width': 800}],
'price': 14600.0,
'price_includes_vat': True,
'registration_date': '2022-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford FIESTA HATCHBACK (2021) 1.0 EcoBoost ST-Line X 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost ST-Line X 5dr',
'vin': 'WF0JXXGAHJNB62685',
'year': 2022}
2026-03-12 20:16:23 [arval.uk] INFO: Saving data for 128779: {'created_time': 1773346583.639901, 'last_price_update_time': 1773346583.639911}
2026-03-12 20:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119109)
2026-03-12 20:16:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766cbd0>
2026-03-12 20:16:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/6.jpeg saved to cache
2026-03-12 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8673390-97f5-5b92-a07d-ba7762e2d8c9
2026-03-12 20:16:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119109)
2026-03-12 20:16:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7a5d0>
2026-03-12 20:16:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/5.jpeg saved to cache
2026-03-12 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8673390-97f5-5b92-a07d-ba7762e2d8c9
2026-03-12 20:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119109)
2026-03-12 20:16:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718f290>
2026-03-12 20:16:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/4.jpeg saved to cache
2026-03-12 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8673390-97f5-5b92-a07d-ba7762e2d8c9
2026-03-12 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119109)
2026-03-12 20:16:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67752ed0>
2026-03-12 20:16:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/3.jpeg saved to cache
2026-03-12 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8673390-97f5-5b92-a07d-ba7762e2d8c9
2026-03-12 20:16:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119109)
2026-03-12 20:16:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67139350>
2026-03-12 20:16:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/2.jpeg saved to cache
2026-03-12 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8673390-97f5-5b92-a07d-ba7762e2d8c9
2026-03-12 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119109)
2026-03-12 20:16:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67638a90>
2026-03-12 20:16:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/1.jpeg saved to cache
2026-03-12 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8673390-97f5-5b92-a07d-ba7762e2d8c9
2026-03-12 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119109)
2026-03-12 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbdee90>
2026-03-12 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/0.jpeg saved to cache
2026-03-12 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8673390-97f5-5b92-a07d-ba7762e2d8c9
2026-03-12 20:16:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8673390-97f5-5b92-a07d-ba7762e2d8c9, skipping ID generation
2026-03-12 20:16:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8673390-97f5-5b92-a07d-ba7762e2d8c9 with scrape type 1
2026-03-12 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8673390-97f5-5b92-a07d-ba7762e2d8c9 sending to next pipeline
2026-03-12 20:16:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: e8673390-97f5-5b92-a07d-ba7762e2d8c9, identifier: 119109
2026-03-12 20:16:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: e8673390-97f5-5b92-a07d-ba7762e2d8c9 with identifier: 119109
2026-03-12 20:16:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: e8673390-97f5-5b92-a07d-ba7762e2d8c9 with identifier: 119109
2026-03-12 20:16:30 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: e8673390-97f5-5b92-a07d-ba7762e2d8c9 with identifier: 119109 to the API
2026-03-12 20:16:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:16:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:16:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 122,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'e8673390-97f5-5b92-a07d-ba7762e2d8c9',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YP72HTF',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-fiesta-hatchback-2021-10-ecoboost-hbd-mhev-125-st-line-vignale-5dr-auto-119109',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'FIESTA HATCHBACK (2021)',
'odometer': 16659,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64585,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70873,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69884,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74871,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63624,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74145,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 22286,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62755,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67230,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8673390-97f5-5b92-a07d-ba7762e2d8c9/e8673390-97f5-5b92-a07d-ba7762e2d8c9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104576,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119109/9.jpeg',
'Width': 800}],
'price': 14700.0,
'price_includes_vat': True,
'registration_date': '2022-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford FIESTA HATCHBACK (2021) 1.0 EcoBoost Hbd mHEV 125 ST-Line '
'Vignale 5dr Auto',
'transmission': 'automatic',
'trim': '1.0 EcoBoost Hbd mHEV 125 ST-Line Vignale 5dr Auto',
'vin': 'WF0JXXGAHJNT24198',
'year': 2022}
2026-03-12 20:16:32 [arval.uk] INFO: Saving data for 119109: {'created_time': 1773346592.101725, 'last_price_update_time': 1773346592.101734}
2026-03-12 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116799)
2026-03-12 20:16:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2b0e50>
2026-03-12 20:16:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/2.jpeg saved to cache
2026-03-12 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1824cec7-b606-5f08-b5fe-a73724181fa8
2026-03-12 20:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116799)
2026-03-12 20:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7aad0>
2026-03-12 20:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/9.jpeg saved to cache
2026-03-12 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1824cec7-b606-5f08-b5fe-a73724181fa8
2026-03-12 20:16:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124007)
2026-03-12 20:16:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66069c50>
2026-03-12 20:16:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/9.jpeg saved to cache
2026-03-12 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98c0f89a-a99d-580d-b217-50c33bd2129e
2026-03-12 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124007)
2026-03-12 20:16:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa6d0>
2026-03-12 20:16:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/8.jpeg saved to cache
2026-03-12 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98c0f89a-a99d-580d-b217-50c33bd2129e
2026-03-12 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123998)
2026-03-12 20:16:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67138190>
2026-03-12 20:16:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/9.jpeg saved to cache
2026-03-12 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b021d16-516c-5313-afb3-a8f22fcfbec4
2026-03-12 20:16:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123998)
2026-03-12 20:16:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef0cd0>
2026-03-12 20:16:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/8.jpeg saved to cache
2026-03-12 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b021d16-516c-5313-afb3-a8f22fcfbec4
2026-03-12 20:16:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123998)
2026-03-12 20:16:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7b590>
2026-03-12 20:16:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/7.jpeg saved to cache
2026-03-12 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b021d16-516c-5313-afb3-a8f22fcfbec4
2026-03-12 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123998)
2026-03-12 20:16:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67647a50>
2026-03-12 20:16:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/6.jpeg saved to cache
2026-03-12 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b021d16-516c-5313-afb3-a8f22fcfbec4
2026-03-12 20:16:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123998)
2026-03-12 20:16:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67198790>
2026-03-12 20:16:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/5.jpeg saved to cache
2026-03-12 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b021d16-516c-5313-afb3-a8f22fcfbec4
2026-03-12 20:16:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123998)
2026-03-12 20:16:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6766cb90>
2026-03-12 20:16:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/4.jpeg saved to cache
2026-03-12 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b021d16-516c-5313-afb3-a8f22fcfbec4
2026-03-12 20:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123998)
2026-03-12 20:16:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67198b90>
2026-03-12 20:16:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/3.jpeg saved to cache
2026-03-12 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b021d16-516c-5313-afb3-a8f22fcfbec4
2026-03-12 20:16:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123998)
2026-03-12 20:16:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a4d50>
2026-03-12 20:16:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/2.jpeg saved to cache
2026-03-12 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b021d16-516c-5313-afb3-a8f22fcfbec4
2026-03-12 20:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123998)
2026-03-12 20:16:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb2750>
2026-03-12 20:16:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/1.jpeg saved to cache
2026-03-12 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b021d16-516c-5313-afb3-a8f22fcfbec4
2026-03-12 20:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123998)
2026-03-12 20:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66053ad0>
2026-03-12 20:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/0.jpeg saved to cache
2026-03-12 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b021d16-516c-5313-afb3-a8f22fcfbec4
2026-03-12 20:16:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b021d16-516c-5313-afb3-a8f22fcfbec4, skipping ID generation
2026-03-12 20:16:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b021d16-516c-5313-afb3-a8f22fcfbec4 with scrape type 1
2026-03-12 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b021d16-516c-5313-afb3-a8f22fcfbec4 sending to next pipeline
2026-03-12 20:16:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 7b021d16-516c-5313-afb3-a8f22fcfbec4, identifier: 123998
2026-03-12 20:16:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 7b021d16-516c-5313-afb3-a8f22fcfbec4 with identifier: 123998
2026-03-12 20:16:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 7b021d16-516c-5313-afb3-a8f22fcfbec4 with identifier: 123998
2026-03-12 20:16:48 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 7b021d16-516c-5313-afb3-a8f22fcfbec4 with identifier: 123998 to the API
2026-03-12 20:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:16:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:16:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 107,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '7b021d16-516c-5313-afb3-a8f22fcfbec4',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YC22YXJ',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/seat-ibiza-hatchback-2021-10-tsi-110-fr-sport-5dr-123998',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Seat',
'model': 'IBIZA HATCHBACK (2021)',
'odometer': 19520,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62913,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61750,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65262,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47318,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50283,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149634,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128254,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77057,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74410,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7b021d16-516c-5313-afb3-a8f22fcfbec4/7b021d16-516c-5313-afb3-a8f22fcfbec4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68742,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123998/9.jpeg',
'Width': 1280}],
'price': 14400.0,
'price_includes_vat': True,
'registration_date': '2022-05-09',
'seats_number': 5,
'seller_name': None,
'title': 'Seat IBIZA HATCHBACK (2021) 1.0 TSI 110 FR Sport 5dr',
'transmission': 'manual',
'trim': '1.0 TSI 110 FR Sport 5dr',
'vin': 'VSSZZZKJZNR097179',
'year': 2022}
2026-03-12 20:16:50 [arval.uk] INFO: Saving data for 123998: {'created_time': 1773346610.247954, 'last_price_update_time': 1773346610.247965}
2026-03-12 20:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124007)
2026-03-12 20:16:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66069750>
2026-03-12 20:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/7.jpeg saved to cache
2026-03-12 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98c0f89a-a99d-580d-b217-50c33bd2129e
2026-03-12 20:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124007)
2026-03-12 20:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ae110>
2026-03-12 20:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/6.jpeg saved to cache
2026-03-12 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98c0f89a-a99d-580d-b217-50c33bd2129e
2026-03-12 20:16:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:16:51 [scrapy.extensions.logstats] INFO: Crawled 131 pages (at 3 pages/min), scraped 103 items (at 5 items/min)
2026-03-12 20:16:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121817> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:16:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36cd10c2-4e61-583b-b768-43b45a21182d with identifier: 121817
2026-03-12 20:16:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36cd10c2-4e61-583b-b768-43b45a21182d with scrape type 1
2026-03-12 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36cd10c2-4e61-583b-b768-43b45a21182d
2026-03-12 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/0.jpeg not downloaded yet
2026-03-12 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/1.jpeg not downloaded yet
2026-03-12 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/2.jpeg not downloaded yet
2026-03-12 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/3.jpeg not downloaded yet
2026-03-12 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/4.jpeg not downloaded yet
2026-03-12 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/5.jpeg not downloaded yet
2026-03-12 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/6.jpeg not downloaded yet
2026-03-12 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/7.jpeg not downloaded yet
2026-03-12 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/8.jpeg not downloaded yet
2026-03-12 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/9.jpeg not downloaded yet
2026-03-12 20:16:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124007)
2026-03-12 20:16:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5ea90>
2026-03-12 20:16:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/5.jpeg saved to cache
2026-03-12 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98c0f89a-a99d-580d-b217-50c33bd2129e
2026-03-12 20:16:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115009> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:16:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a88a8e-7816-581b-a0c1-b93490015ea9 with identifier: 115009
2026-03-12 20:16:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a88a8e-7816-581b-a0c1-b93490015ea9 with scrape type 1
2026-03-12 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43a88a8e-7816-581b-a0c1-b93490015ea9
2026-03-12 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/0.jpeg not downloaded yet
2026-03-12 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/1.jpeg not downloaded yet
2026-03-12 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/2.jpeg not downloaded yet
2026-03-12 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/3.jpeg not downloaded yet
2026-03-12 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/4.jpeg not downloaded yet
2026-03-12 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/5.jpeg not downloaded yet
2026-03-12 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/6.jpeg not downloaded yet
2026-03-12 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/7.jpeg not downloaded yet
2026-03-12 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/8.jpeg not downloaded yet
2026-03-12 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/9.jpeg not downloaded yet
2026-03-12 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124007)
2026-03-12 20:16:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606afd0>
2026-03-12 20:16:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/4.jpeg saved to cache
2026-03-12 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98c0f89a-a99d-580d-b217-50c33bd2129e
2026-03-12 20:16:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128558> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:16:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72eabb4f-e842-5a4f-acff-b4e82ac07c60 with identifier: 128558
2026-03-12 20:16:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60 with scrape type 1
2026-03-12 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60
2026-03-12 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/0.jpeg not downloaded yet
2026-03-12 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/1.jpeg not downloaded yet
2026-03-12 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/2.jpeg not downloaded yet
2026-03-12 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/3.jpeg not downloaded yet
2026-03-12 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/4.jpeg not downloaded yet
2026-03-12 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/5.jpeg not downloaded yet
2026-03-12 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/6.jpeg not downloaded yet
2026-03-12 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/7.jpeg not downloaded yet
2026-03-12 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/8.jpeg not downloaded yet
2026-03-12 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/9.jpeg not downloaded yet
2026-03-12 20:16:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124007)
2026-03-12 20:16:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6713a750>
2026-03-12 20:16:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/3.jpeg saved to cache
2026-03-12 20:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98c0f89a-a99d-580d-b217-50c33bd2129e
2026-03-12 20:16:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124007)
2026-03-12 20:16:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb2750>
2026-03-12 20:16:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/2.jpeg saved to cache
2026-03-12 20:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98c0f89a-a99d-580d-b217-50c33bd2129e
2026-03-12 20:16:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124007)
2026-03-12 20:16:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604f550>
2026-03-12 20:16:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/1.jpeg saved to cache
2026-03-12 20:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98c0f89a-a99d-580d-b217-50c33bd2129e
2026-03-12 20:16:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124007)
2026-03-12 20:16:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:16:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a4890>
2026-03-12 20:16:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:16:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:16:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:16:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/0.jpeg saved to cache
2026-03-12 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98c0f89a-a99d-580d-b217-50c33bd2129e
2026-03-12 20:16:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98c0f89a-a99d-580d-b217-50c33bd2129e, skipping ID generation
2026-03-12 20:16:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98c0f89a-a99d-580d-b217-50c33bd2129e with scrape type 1
2026-03-12 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98c0f89a-a99d-580d-b217-50c33bd2129e sending to next pipeline
2026-03-12 20:16:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 98c0f89a-a99d-580d-b217-50c33bd2129e, identifier: 124007
2026-03-12 20:16:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 98c0f89a-a99d-580d-b217-50c33bd2129e with identifier: 124007
2026-03-12 20:16:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-12 20:16:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 98c0f89a-a99d-580d-b217-50c33bd2129e with identifier: 124007
2026-03-12 20:16:59 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 98c0f89a-a99d-580d-b217-50c33bd2129e with identifier: 124007 to the API
2026-03-12 20:16:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:17:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:17:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 129,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '98c0f89a-a99d-580d-b217-50c33bd2129e',
'is_damaged': False,
'is_operable': True,
'license_plate': 'AF72DDU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/peugeot-2008-estate-2019-12-puretech-130-gt-5dr-124007',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Peugeot',
'model': '2008 ESTATE (2019)',
'odometer': 20418,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65567,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60560,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58225,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47427,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54225,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140186,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70315,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86413,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92965,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98c0f89a-a99d-580d-b217-50c33bd2129e/98c0f89a-a99d-580d-b217-50c33bd2129e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86473,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124007/9.jpeg',
'Width': 1280}],
'price': 14500.0,
'price_includes_vat': True,
'registration_date': '2022-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 ESTATE (2019) 1.2 PureTech 130 GT 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech 130 GT 5dr',
'vin': 'VR3USHNSKNJ721529',
'year': 2022}
2026-03-12 20:17:05 [arval.uk] INFO: Saving data for 124007: {'created_time': 1773346625.488918, 'last_price_update_time': 1773346625.488927}
2026-03-12 20:17:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116799)
2026-03-12 20:17:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677c9750>
2026-03-12 20:17:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/8.jpeg saved to cache
2026-03-12 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1824cec7-b606-5f08-b5fe-a73724181fa8
2026-03-12 20:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116799)
2026-03-12 20:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f45fd0>
2026-03-12 20:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/7.jpeg saved to cache
2026-03-12 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1824cec7-b606-5f08-b5fe-a73724181fa8
2026-03-12 20:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116799)
2026-03-12 20:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ad290>
2026-03-12 20:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/6.jpeg saved to cache
2026-03-12 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1824cec7-b606-5f08-b5fe-a73724181fa8
2026-03-12 20:17:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116799)
2026-03-12 20:17:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f8390>
2026-03-12 20:17:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/5.jpeg saved to cache
2026-03-12 20:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1824cec7-b606-5f08-b5fe-a73724181fa8
2026-03-12 20:17:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116799)
2026-03-12 20:17:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606a450>
2026-03-12 20:17:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/4.jpeg saved to cache
2026-03-12 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1824cec7-b606-5f08-b5fe-a73724181fa8
2026-03-12 20:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116799)
2026-03-12 20:17:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6771b790>
2026-03-12 20:17:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/3.jpeg saved to cache
2026-03-12 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1824cec7-b606-5f08-b5fe-a73724181fa8
2026-03-12 20:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116799)
2026-03-12 20:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67138b50>
2026-03-12 20:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/1.jpeg saved to cache
2026-03-12 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1824cec7-b606-5f08-b5fe-a73724181fa8
2026-03-12 20:17:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116799)
2026-03-12 20:17:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67617c90>
2026-03-12 20:17:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/0.jpeg saved to cache
2026-03-12 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1824cec7-b606-5f08-b5fe-a73724181fa8
2026-03-12 20:17:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1824cec7-b606-5f08-b5fe-a73724181fa8, skipping ID generation
2026-03-12 20:17:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1824cec7-b606-5f08-b5fe-a73724181fa8 with scrape type 1
2026-03-12 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1824cec7-b606-5f08-b5fe-a73724181fa8 sending to next pipeline
2026-03-12 20:17:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 1824cec7-b606-5f08-b5fe-a73724181fa8, identifier: 116799
2026-03-12 20:17:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 1824cec7-b606-5f08-b5fe-a73724181fa8 with identifier: 116799
2026-03-12 20:17:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 1824cec7-b606-5f08-b5fe-a73724181fa8 with identifier: 116799
2026-03-12 20:17:15 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 1824cec7-b606-5f08-b5fe-a73724181fa8 with identifier: 116799 to the API
2026-03-12 20:17:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:17:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:17:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 218,
'expiration_date': None,
'fuel_type': 'PHEV',
'id': '1824cec7-b606-5f08-b5fe-a73724181fa8',
'is_damaged': False,
'is_operable': True,
'license_plate': 'HX71XPS',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/bmw-2-series-active-tourer-2018-225xe-220-luxury-5dr-auto-116799',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'BMW',
'model': '2 SERIES ACTIVE TOURER (2018)',
'odometer': 38654,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 55,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61271,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56471,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59099,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55035,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60948,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58626,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54633,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55463,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114477,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1824cec7-b606-5f08-b5fe-a73724181fa8/1824cec7-b606-5f08-b5fe-a73724181fa8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64797,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116799/9.jpeg',
'Width': 800}],
'price': 14600.0,
'price_includes_vat': True,
'registration_date': '2021-09-08',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 2 SERIES ACTIVE TOURER (2018) 225xe [220] Luxury 5dr Auto',
'transmission': 'automatic',
'trim': '225xe [220] Luxury 5dr Auto',
'vin': 'WBA6Y320107J97542',
'year': 2021}
2026-03-12 20:17:15 [arval.uk] INFO: Saving data for 116799: {'created_time': 1773346635.656012, 'last_price_update_time': 1773346635.656022}
2026-03-12 20:17:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121817)
2026-03-12 20:17:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f44910>
2026-03-12 20:17:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/9.jpeg saved to cache
2026-03-12 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36cd10c2-4e61-583b-b768-43b45a21182d
2026-03-12 20:17:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121817)
2026-03-12 20:17:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677197d0>
2026-03-12 20:17:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/8.jpeg saved to cache
2026-03-12 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36cd10c2-4e61-583b-b768-43b45a21182d
2026-03-12 20:17:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115009)
2026-03-12 20:17:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f79b10>
2026-03-12 20:17:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/9.jpeg saved to cache
2026-03-12 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43a88a8e-7816-581b-a0c1-b93490015ea9
2026-03-12 20:17:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115009)
2026-03-12 20:17:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67615810>
2026-03-12 20:17:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/8.jpeg saved to cache
2026-03-12 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43a88a8e-7816-581b-a0c1-b93490015ea9
2026-03-12 20:17:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128558)
2026-03-12 20:17:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606ba50>
2026-03-12 20:17:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/9.jpeg saved to cache
2026-03-12 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60
2026-03-12 20:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128558)
2026-03-12 20:17:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67751890>
2026-03-12 20:17:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/8.jpeg saved to cache
2026-03-12 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60
2026-03-12 20:17:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128558)
2026-03-12 20:17:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb21d0>
2026-03-12 20:17:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/7.jpeg saved to cache
2026-03-12 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60
2026-03-12 20:17:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128558)
2026-03-12 20:17:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a71d0>
2026-03-12 20:17:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/6.jpeg saved to cache
2026-03-12 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60
2026-03-12 20:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128558)
2026-03-12 20:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66069390>
2026-03-12 20:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/5.jpeg saved to cache
2026-03-12 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60
2026-03-12 20:17:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128558)
2026-03-12 20:17:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ab390>
2026-03-12 20:17:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/4.jpeg saved to cache
2026-03-12 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60
2026-03-12 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128558)
2026-03-12 20:17:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee3390>
2026-03-12 20:17:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/3.jpeg saved to cache
2026-03-12 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60
2026-03-12 20:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128558)
2026-03-12 20:17:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4d8d0>
2026-03-12 20:17:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/2.jpeg saved to cache
2026-03-12 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60
2026-03-12 20:17:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128558)
2026-03-12 20:17:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67663110>
2026-03-12 20:17:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/1.jpeg saved to cache
2026-03-12 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60
2026-03-12 20:17:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128558)
2026-03-12 20:17:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee2b90>
2026-03-12 20:17:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/0.jpeg saved to cache
2026-03-12 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60
2026-03-12 20:17:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72eabb4f-e842-5a4f-acff-b4e82ac07c60, skipping ID generation
2026-03-12 20:17:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60 with scrape type 1
2026-03-12 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72eabb4f-e842-5a4f-acff-b4e82ac07c60 sending to next pipeline
2026-03-12 20:17:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 72eabb4f-e842-5a4f-acff-b4e82ac07c60, identifier: 128558
2026-03-12 20:17:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 72eabb4f-e842-5a4f-acff-b4e82ac07c60 with identifier: 128558
2026-03-12 20:17:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 72eabb4f-e842-5a4f-acff-b4e82ac07c60 with identifier: 128558
2026-03-12 20:17:31 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 72eabb4f-e842-5a4f-acff-b4e82ac07c60 with identifier: 128558 to the API
2026-03-12 20:17:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:17:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:17:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 154,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '72eabb4f-e842-5a4f-acff-b4e82ac07c60',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YM22TFU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-fiesta-hatchback-2021-10-ecoboost-hybrid-mhev-155-st-line-vignale-5dr-128558',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'FIESTA HATCHBACK (2021)',
'odometer': 24480,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89356,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89185,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99180,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86741,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82355,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98767,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87529,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65826,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 17733,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_72eabb4f-e842-5a4f-acff-b4e82ac07c60/72eabb4f-e842-5a4f-acff-b4e82ac07c60_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63507,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128558/9.jpeg',
'Width': 800}],
'price': 14200.0,
'price_includes_vat': True,
'registration_date': '2022-07-25',
'seats_number': 5,
'seller_name': None,
'title': 'Ford FIESTA HATCHBACK (2021) 1.0 EcoBoost Hybrid mHEV 155 ST-Line '
'Vignale 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost Hybrid mHEV 155 ST-Line Vignale 5dr',
'vin': 'WF0JXXGAHJNJ35856',
'year': 2022}
2026-03-12 20:17:31 [arval.uk] INFO: Saving data for 128558: {'created_time': 1773346651.921454, 'last_price_update_time': 1773346651.921464}
2026-03-12 20:17:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115009)
2026-03-12 20:17:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:17:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67663810>
2026-03-12 20:17:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/7.jpeg saved to cache
2026-03-12 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43a88a8e-7816-581b-a0c1-b93490015ea9
2026-03-12 20:17:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115009)
2026-03-12 20:17:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66079b10>
2026-03-12 20:17:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/6.jpeg saved to cache
2026-03-12 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43a88a8e-7816-581b-a0c1-b93490015ea9
2026-03-12 20:17:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:17:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123340> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:17:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51c94d88-f260-50dd-b068-e5baacd93dd5 with identifier: 123340
2026-03-12 20:17:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51c94d88-f260-50dd-b068-e5baacd93dd5 with scrape type 1
2026-03-12 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51c94d88-f260-50dd-b068-e5baacd93dd5
2026-03-12 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/0.jpeg not downloaded yet
2026-03-12 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/1.jpeg not downloaded yet
2026-03-12 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/2.jpeg not downloaded yet
2026-03-12 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/3.jpeg not downloaded yet
2026-03-12 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/4.jpeg not downloaded yet
2026-03-12 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/5.jpeg not downloaded yet
2026-03-12 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/6.jpeg not downloaded yet
2026-03-12 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/7.jpeg not downloaded yet
2026-03-12 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/8.jpeg not downloaded yet
2026-03-12 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/9.jpeg not downloaded yet
2026-03-12 20:17:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115009)
2026-03-12 20:17:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676609d0>
2026-03-12 20:17:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/5.jpeg saved to cache
2026-03-12 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43a88a8e-7816-581b-a0c1-b93490015ea9
2026-03-12 20:17:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128562> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:17:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc90c4ca-12cd-515a-b185-3ff37df1efd2 with identifier: 128562
2026-03-12 20:17:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc90c4ca-12cd-515a-b185-3ff37df1efd2 with scrape type 1
2026-03-12 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc90c4ca-12cd-515a-b185-3ff37df1efd2
2026-03-12 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/0.jpeg not downloaded yet
2026-03-12 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/1.jpeg not downloaded yet
2026-03-12 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/2.jpeg not downloaded yet
2026-03-12 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/3.jpeg not downloaded yet
2026-03-12 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/4.jpeg not downloaded yet
2026-03-12 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/5.jpeg not downloaded yet
2026-03-12 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/6.jpeg not downloaded yet
2026-03-12 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/7.jpeg not downloaded yet
2026-03-12 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/8.jpeg not downloaded yet
2026-03-12 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/9.jpeg not downloaded yet
2026-03-12 20:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115009)
2026-03-12 20:17:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4fe90>
2026-03-12 20:17:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/4.jpeg saved to cache
2026-03-12 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43a88a8e-7816-581b-a0c1-b93490015ea9
2026-03-12 20:17:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122950> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:17:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d038bd69-cf20-5c1c-ae58-3dfd1a15e93e with identifier: 122950
2026-03-12 20:17:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e with scrape type 1
2026-03-12 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e
2026-03-12 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/0.jpeg not downloaded yet
2026-03-12 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/1.jpeg not downloaded yet
2026-03-12 20:17:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115009)
2026-03-12 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/2.jpeg not downloaded yet
2026-03-12 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/3.jpeg not downloaded yet
2026-03-12 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/4.jpeg not downloaded yet
2026-03-12 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/5.jpeg not downloaded yet
2026-03-12 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/6.jpeg not downloaded yet
2026-03-12 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/7.jpeg not downloaded yet
2026-03-12 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/8.jpeg not downloaded yet
2026-03-12 20:17:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b6790>
2026-03-12 20:17:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/3.jpeg saved to cache
2026-03-12 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43a88a8e-7816-581b-a0c1-b93490015ea9
2026-03-12 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/9.jpeg not downloaded yet
2026-03-12 20:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115009)
2026-03-12 20:17:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762b910>
2026-03-12 20:17:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/2.jpeg saved to cache
2026-03-12 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43a88a8e-7816-581b-a0c1-b93490015ea9
2026-03-12 20:17:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115009)
2026-03-12 20:17:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f55d90>
2026-03-12 20:17:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/1.jpeg saved to cache
2026-03-12 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43a88a8e-7816-581b-a0c1-b93490015ea9
2026-03-12 20:17:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115009)
2026-03-12 20:17:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb0290>
2026-03-12 20:17:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/0.jpeg saved to cache
2026-03-12 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43a88a8e-7816-581b-a0c1-b93490015ea9
2026-03-12 20:17:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43a88a8e-7816-581b-a0c1-b93490015ea9, skipping ID generation
2026-03-12 20:17:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a88a8e-7816-581b-a0c1-b93490015ea9 with scrape type 1
2026-03-12 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43a88a8e-7816-581b-a0c1-b93490015ea9 sending to next pipeline
2026-03-12 20:17:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 43a88a8e-7816-581b-a0c1-b93490015ea9, identifier: 115009
2026-03-12 20:17:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 43a88a8e-7816-581b-a0c1-b93490015ea9 with identifier: 115009
2026-03-12 20:17:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 43a88a8e-7816-581b-a0c1-b93490015ea9 with identifier: 115009
2026-03-12 20:17:41 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 43a88a8e-7816-581b-a0c1-b93490015ea9 with identifier: 115009 to the API
2026-03-12 20:17:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:17:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:17:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 129,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '43a88a8e-7816-581b-a0c1-b93490015ea9',
'is_damaged': False,
'is_operable': True,
'license_plate': 'AF72XXO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/peugeot-2008-estate-2019-12-puretech-130-gt-5dr-115009',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Peugeot',
'model': '2008 ESTATE (2019)',
'odometer': 18047,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74584,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63528,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66553,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53293,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59306,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158233,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59413,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79391,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79381,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a88a8e-7816-581b-a0c1-b93490015ea9/43a88a8e-7816-581b-a0c1-b93490015ea9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107311,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115009/9.jpeg',
'Width': 1280}],
'price': 14400.0,
'price_includes_vat': True,
'registration_date': '2022-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 ESTATE (2019) 1.2 PureTech 130 GT 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech 130 GT 5dr',
'vin': 'VR3USHNSKNJ745668',
'year': 2022}
2026-03-12 20:17:41 [arval.uk] INFO: Saving data for 115009: {'created_time': 1773346661.645119, 'last_price_update_time': 1773346661.645127}
2026-03-12 20:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121817)
2026-03-12 20:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604c110>
2026-03-12 20:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/7.jpeg saved to cache
2026-03-12 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36cd10c2-4e61-583b-b768-43b45a21182d
2026-03-12 20:17:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121817)
2026-03-12 20:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762a750>
2026-03-12 20:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/6.jpeg saved to cache
2026-03-12 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36cd10c2-4e61-583b-b768-43b45a21182d
2026-03-12 20:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121817)
2026-03-12 20:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f57650>
2026-03-12 20:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/5.jpeg saved to cache
2026-03-12 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36cd10c2-4e61-583b-b768-43b45a21182d
2026-03-12 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121817)
2026-03-12 20:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6710ef50>
2026-03-12 20:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/4.jpeg saved to cache
2026-03-12 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36cd10c2-4e61-583b-b768-43b45a21182d
2026-03-12 20:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121817)
2026-03-12 20:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedb590>
2026-03-12 20:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/3.jpeg saved to cache
2026-03-12 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36cd10c2-4e61-583b-b768-43b45a21182d
2026-03-12 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121817)
2026-03-12 20:17:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604fa90>
2026-03-12 20:17:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/2.jpeg saved to cache
2026-03-12 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36cd10c2-4e61-583b-b768-43b45a21182d
2026-03-12 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121817)
2026-03-12 20:17:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f57c10>
2026-03-12 20:17:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/1.jpeg saved to cache
2026-03-12 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36cd10c2-4e61-583b-b768-43b45a21182d
2026-03-12 20:17:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121817)
2026-03-12 20:17:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb7a50>
2026-03-12 20:17:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/0.jpeg saved to cache
2026-03-12 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36cd10c2-4e61-583b-b768-43b45a21182d
2026-03-12 20:17:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36cd10c2-4e61-583b-b768-43b45a21182d, skipping ID generation
2026-03-12 20:17:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36cd10c2-4e61-583b-b768-43b45a21182d with scrape type 1
2026-03-12 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36cd10c2-4e61-583b-b768-43b45a21182d sending to next pipeline
2026-03-12 20:17:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 36cd10c2-4e61-583b-b768-43b45a21182d, identifier: 121817
2026-03-12 20:17:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 36cd10c2-4e61-583b-b768-43b45a21182d with identifier: 121817
2026-03-12 20:17:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 36cd10c2-4e61-583b-b768-43b45a21182d with identifier: 121817
2026-03-12 20:17:50 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 36cd10c2-4e61-583b-b768-43b45a21182d with identifier: 121817 to the API
2026-03-12 20:17:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:17:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:17:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 120,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '36cd10c2-4e61-583b-b768-43b45a21182d',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YX72HXO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/mazda-cx-30-hatchback-2020-20-e-skyactiv-g-mhev-gt-sport-edition-5dr-121817',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Mazda',
'model': 'CX-30 HATCHBACK (2020)',
'odometer': 39006,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 47,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69669,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73836,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28375,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64509,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60379,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64422,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57796,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19971,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41510,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36cd10c2-4e61-583b-b768-43b45a21182d/36cd10c2-4e61-583b-b768-43b45a21182d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62521,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121817/9.jpeg',
'Width': 800}],
'price': 14400.0,
'price_includes_vat': True,
'registration_date': '2022-10-09',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-30 HATCHBACK (2020) 2.0 e-Skyactiv G MHEV GT Sport Edition '
'5dr',
'transmission': 'manual',
'trim': '2.0 e-Skyactiv G MHEV GT Sport Edition 5dr',
'vin': 'JMZDM6WE600314812',
'year': 2022}
2026-03-12 20:17:50 [arval.uk] INFO: Saving data for 121817: {'created_time': 1773346670.822651, 'last_price_update_time': 1773346670.822659}
2026-03-12 20:17:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123340)
2026-03-12 20:17:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b7510>
2026-03-12 20:17:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/9.jpeg saved to cache
2026-03-12 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51c94d88-f260-50dd-b068-e5baacd93dd5
2026-03-12 20:17:51 [scrapy.extensions.logstats] INFO: Crawled 137 pages (at 6 pages/min), scraped 108 items (at 5 items/min)
2026-03-12 20:17:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123340)
2026-03-12 20:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604de10>
2026-03-12 20:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/8.jpeg saved to cache
2026-03-12 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51c94d88-f260-50dd-b068-e5baacd93dd5
2026-03-12 20:17:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128562)
2026-03-12 20:17:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67120f90>
2026-03-12 20:17:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/9.jpeg saved to cache
2026-03-12 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc90c4ca-12cd-515a-b185-3ff37df1efd2
2026-03-12 20:17:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128562)
2026-03-12 20:17:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604f810>
2026-03-12 20:17:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/8.jpeg saved to cache
2026-03-12 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc90c4ca-12cd-515a-b185-3ff37df1efd2
2026-03-12 20:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122950)
2026-03-12 20:17:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67178bd0>
2026-03-12 20:17:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/0.jpeg saved to cache
2026-03-12 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e
2026-03-12 20:17:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122950)
2026-03-12 20:17:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762ae50>
2026-03-12 20:17:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/9.jpeg saved to cache
2026-03-12 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e
2026-03-12 20:17:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122950)
2026-03-12 20:17:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:17:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f4f290>
2026-03-12 20:17:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:17:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:17:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/8.jpeg saved to cache
2026-03-12 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e
2026-03-12 20:18:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122950)
2026-03-12 20:18:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604e090>
2026-03-12 20:18:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/7.jpeg saved to cache
2026-03-12 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e
2026-03-12 20:18:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122950)
2026-03-12 20:18:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a5090>
2026-03-12 20:18:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/6.jpeg saved to cache
2026-03-12 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e
2026-03-12 20:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122950)
2026-03-12 20:18:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762a8d0>
2026-03-12 20:18:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/5.jpeg saved to cache
2026-03-12 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e
2026-03-12 20:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122950)
2026-03-12 20:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb3f10>
2026-03-12 20:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/4.jpeg saved to cache
2026-03-12 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e
2026-03-12 20:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122950)
2026-03-12 20:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67705a10>
2026-03-12 20:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/3.jpeg saved to cache
2026-03-12 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e
2026-03-12 20:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122950)
2026-03-12 20:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712b990>
2026-03-12 20:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/2.jpeg saved to cache
2026-03-12 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e
2026-03-12 20:18:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122950)
2026-03-12 20:18:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676399d0>
2026-03-12 20:18:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/1.jpeg saved to cache
2026-03-12 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e
2026-03-12 20:18:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d038bd69-cf20-5c1c-ae58-3dfd1a15e93e, skipping ID generation
2026-03-12 20:18:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e with scrape type 1
2026-03-12 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d038bd69-cf20-5c1c-ae58-3dfd1a15e93e sending to next pipeline
2026-03-12 20:18:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: d038bd69-cf20-5c1c-ae58-3dfd1a15e93e, identifier: 122950
2026-03-12 20:18:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: d038bd69-cf20-5c1c-ae58-3dfd1a15e93e with identifier: 122950
2026-03-12 20:18:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: d038bd69-cf20-5c1c-ae58-3dfd1a15e93e with identifier: 122950
2026-03-12 20:18:07 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: d038bd69-cf20-5c1c-ae58-3dfd1a15e93e with identifier: 122950 to the API
2026-03-12 20:18:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:18:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:18:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/1.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 107,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'd038bd69-cf20-5c1c-ae58-3dfd1a15e93e',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YG73ZYX',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/seat-ibiza-hatchback-2021-10-tsi-110-fr-5dr-122950',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Seat',
'model': 'IBIZA HATCHBACK (2021)',
'odometer': 12955,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 49,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75496,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73661,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37054,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71536,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69665,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76401,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63171,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19073,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37812,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d038bd69-cf20-5c1c-ae58-3dfd1a15e93e/d038bd69-cf20-5c1c-ae58-3dfd1a15e93e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74221,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122950/9.jpeg',
'Width': 800}],
'price': 14000.0,
'price_includes_vat': True,
'registration_date': '2023-09-07',
'seats_number': 5,
'seller_name': None,
'title': 'Seat IBIZA HATCHBACK (2021) 1.0 TSI 110 FR 5dr',
'transmission': 'manual',
'trim': '1.0 TSI 110 FR 5dr',
'vin': 'VSSZZZKJ1PR146435',
'year': 2023}
2026-03-12 20:18:07 [arval.uk] INFO: Saving data for 122950: {'created_time': 1773346687.785265, 'last_price_update_time': 1773346687.785276}
2026-03-12 20:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128562)
2026-03-12 20:18:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67122590>
2026-03-12 20:18:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/7.jpeg saved to cache
2026-03-12 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc90c4ca-12cd-515a-b185-3ff37df1efd2
2026-03-12 20:18:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128562)
2026-03-12 20:18:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67638e50>
2026-03-12 20:18:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/6.jpeg saved to cache
2026-03-12 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc90c4ca-12cd-515a-b185-3ff37df1efd2
2026-03-12 20:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128562)
2026-03-12 20:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c116cd0>
2026-03-12 20:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/5.jpeg saved to cache
2026-03-12 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc90c4ca-12cd-515a-b185-3ff37df1efd2
2026-03-12 20:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128562)
2026-03-12 20:18:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763b550>
2026-03-12 20:18:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/4.jpeg saved to cache
2026-03-12 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc90c4ca-12cd-515a-b185-3ff37df1efd2
2026-03-12 20:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128562)
2026-03-12 20:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb2c90>
2026-03-12 20:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/3.jpeg saved to cache
2026-03-12 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc90c4ca-12cd-515a-b185-3ff37df1efd2
2026-03-12 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128562)
2026-03-12 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67120190>
2026-03-12 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/2.jpeg saved to cache
2026-03-12 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc90c4ca-12cd-515a-b185-3ff37df1efd2
2026-03-12 20:18:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128562)
2026-03-12 20:18:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6710fc50>
2026-03-12 20:18:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/1.jpeg saved to cache
2026-03-12 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc90c4ca-12cd-515a-b185-3ff37df1efd2
2026-03-12 20:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128562)
2026-03-12 20:18:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67638e90>
2026-03-12 20:18:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/0.jpeg saved to cache
2026-03-12 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc90c4ca-12cd-515a-b185-3ff37df1efd2
2026-03-12 20:18:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc90c4ca-12cd-515a-b185-3ff37df1efd2, skipping ID generation
2026-03-12 20:18:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc90c4ca-12cd-515a-b185-3ff37df1efd2 with scrape type 1
2026-03-12 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc90c4ca-12cd-515a-b185-3ff37df1efd2 sending to next pipeline
2026-03-12 20:18:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: bc90c4ca-12cd-515a-b185-3ff37df1efd2, identifier: 128562
2026-03-12 20:18:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: bc90c4ca-12cd-515a-b185-3ff37df1efd2 with identifier: 128562
2026-03-12 20:18:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: bc90c4ca-12cd-515a-b185-3ff37df1efd2 with identifier: 128562
2026-03-12 20:18:17 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: bc90c4ca-12cd-515a-b185-3ff37df1efd2 with identifier: 128562 to the API
2026-03-12 20:18:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:18:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:18:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 107,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'bc90c4ca-12cd-515a-b185-3ff37df1efd2',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DA73GWP',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/seat-ibiza-hatchback-2021-10-tsi-110-fr-5dr-128562',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Seat',
'model': 'IBIZA HATCHBACK (2021)',
'odometer': 14214,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 47,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99319,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83738,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101041,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101561,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102795,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73879,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93835,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103879,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63035,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc90c4ca-12cd-515a-b185-3ff37df1efd2/bc90c4ca-12cd-515a-b185-3ff37df1efd2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33662,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128562/9.jpeg',
'Width': 800}],
'price': 14000.0,
'price_includes_vat': True,
'registration_date': '2023-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Seat IBIZA HATCHBACK (2021) 1.0 TSI 110 FR 5dr',
'transmission': 'manual',
'trim': '1.0 TSI 110 FR 5dr',
'vin': 'VSSZZZKJ4RR018564',
'year': 2023}
2026-03-12 20:18:20 [arval.uk] INFO: Saving data for 128562: {'created_time': 1773346700.003226, 'last_price_update_time': 1773346700.00324}
2026-03-12 20:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123340)
2026-03-12 20:18:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:18:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee2d10>
2026-03-12 20:18:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/7.jpeg saved to cache
2026-03-12 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51c94d88-f260-50dd-b068-e5baacd93dd5
2026-03-12 20:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123340)
2026-03-12 20:18:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67638b10>
2026-03-12 20:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/6.jpeg saved to cache
2026-03-12 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51c94d88-f260-50dd-b068-e5baacd93dd5
2026-03-12 20:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118146> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:18:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8f8e820-8a8a-51fb-9011-7de9f2b16c26 with identifier: 118146
2026-03-12 20:18:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26 with scrape type 1
2026-03-12 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26
2026-03-12 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/0.jpeg not downloaded yet
2026-03-12 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/1.jpeg not downloaded yet
2026-03-12 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/2.jpeg not downloaded yet
2026-03-12 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/3.jpeg not downloaded yet
2026-03-12 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/4.jpeg not downloaded yet
2026-03-12 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/5.jpeg not downloaded yet
2026-03-12 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/6.jpeg not downloaded yet
2026-03-12 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/7.jpeg not downloaded yet
2026-03-12 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/8.jpeg not downloaded yet
2026-03-12 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/9.jpeg not downloaded yet
2026-03-12 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123340)
2026-03-12 20:18:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a5450>
2026-03-12 20:18:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/5.jpeg saved to cache
2026-03-12 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51c94d88-f260-50dd-b068-e5baacd93dd5
2026-03-12 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/109683> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:18:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:18:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c558db4f-e407-53a9-b9b3-30869ab44956 with identifier: 109683
2026-03-12 20:18:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c558db4f-e407-53a9-b9b3-30869ab44956 with scrape type 1
2026-03-12 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c558db4f-e407-53a9-b9b3-30869ab44956
2026-03-12 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/0.jpeg not downloaded yet
2026-03-12 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/1.jpeg not downloaded yet
2026-03-12 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/2.jpeg not downloaded yet
2026-03-12 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/3.jpeg not downloaded yet
2026-03-12 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/4.jpeg not downloaded yet
2026-03-12 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/5.jpeg not downloaded yet
2026-03-12 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/6.jpeg not downloaded yet
2026-03-12 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/7.jpeg not downloaded yet
2026-03-12 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/8.jpeg not downloaded yet
2026-03-12 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/9.jpeg not downloaded yet
2026-03-12 20:18:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123340)
2026-03-12 20:18:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128780> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:18:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f78a50>
2026-03-12 20:18:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/4.jpeg saved to cache
2026-03-12 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51c94d88-f260-50dd-b068-e5baacd93dd5
2026-03-12 20:18:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56caafd1-7a9e-59ff-b281-cc9a6a38280f with identifier: 128780
2026-03-12 20:18:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f with scrape type 1
2026-03-12 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f
2026-03-12 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/0.jpeg not downloaded yet
2026-03-12 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/1.jpeg not downloaded yet
2026-03-12 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/2.jpeg not downloaded yet
2026-03-12 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/3.jpeg not downloaded yet
2026-03-12 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/4.jpeg not downloaded yet
2026-03-12 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/5.jpeg not downloaded yet
2026-03-12 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/6.jpeg not downloaded yet
2026-03-12 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/7.jpeg not downloaded yet
2026-03-12 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/8.jpeg not downloaded yet
2026-03-12 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/9.jpeg not downloaded yet
2026-03-12 20:18:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123340)
2026-03-12 20:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f8e10>
2026-03-12 20:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/3.jpeg saved to cache
2026-03-12 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51c94d88-f260-50dd-b068-e5baacd93dd5
2026-03-12 20:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123340)
2026-03-12 20:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f35bd0>
2026-03-12 20:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/2.jpeg saved to cache
2026-03-12 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51c94d88-f260-50dd-b068-e5baacd93dd5
2026-03-12 20:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123340)
2026-03-12 20:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67122c90>
2026-03-12 20:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/1.jpeg saved to cache
2026-03-12 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51c94d88-f260-50dd-b068-e5baacd93dd5
2026-03-12 20:18:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123340)
2026-03-12 20:18:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660697d0>
2026-03-12 20:18:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/0.jpeg saved to cache
2026-03-12 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51c94d88-f260-50dd-b068-e5baacd93dd5
2026-03-12 20:18:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51c94d88-f260-50dd-b068-e5baacd93dd5, skipping ID generation
2026-03-12 20:18:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51c94d88-f260-50dd-b068-e5baacd93dd5 with scrape type 1
2026-03-12 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51c94d88-f260-50dd-b068-e5baacd93dd5 sending to next pipeline
2026-03-12 20:18:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 51c94d88-f260-50dd-b068-e5baacd93dd5, identifier: 123340
2026-03-12 20:18:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 51c94d88-f260-50dd-b068-e5baacd93dd5 with identifier: 123340
2026-03-12 20:18:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 51c94d88-f260-50dd-b068-e5baacd93dd5 with identifier: 123340
2026-03-12 20:18:28 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 51c94d88-f260-50dd-b068-e5baacd93dd5 with identifier: 123340 to the API
2026-03-12 20:18:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:18:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:18:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 99,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '51c94d88-f260-50dd-b068-e5baacd93dd5',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YP72TNO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-fiesta-hatchback-2021-10-ecoboost-st-line-x-5dr-123340',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'FIESTA HATCHBACK (2021)',
'odometer': 11420,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 62,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48424,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47829,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28790,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48969,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42137,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46536,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47665,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37212,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50539,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51c94d88-f260-50dd-b068-e5baacd93dd5/51c94d88-f260-50dd-b068-e5baacd93dd5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31073,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123340/9.jpeg',
'Width': 800}],
'price': 14100.0,
'price_includes_vat': True,
'registration_date': '2022-11-13',
'seats_number': 5,
'seller_name': None,
'title': 'Ford FIESTA HATCHBACK (2021) 1.0 EcoBoost ST-Line X 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost ST-Line X 5dr',
'vin': 'WF0JXXGAHJNB62962',
'year': 2022}
2026-03-12 20:18:28 [arval.uk] INFO: Saving data for 123340: {'created_time': 1773346708.866496, 'last_price_update_time': 1773346708.866505}
2026-03-12 20:18:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127057)
2026-03-12 20:18:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f78b50>
2026-03-12 20:18:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/7.jpeg saved to cache
2026-03-12 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687
2026-03-12 20:18:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127057)
2026-03-12 20:18:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677eb2d0>
2026-03-12 20:18:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/6.jpeg saved to cache
2026-03-12 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687
2026-03-12 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127057)
2026-03-12 20:18:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16e950>
2026-03-12 20:18:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/5.jpeg saved to cache
2026-03-12 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687
2026-03-12 20:18:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127057)
2026-03-12 20:18:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc52150>
2026-03-12 20:18:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/4.jpeg saved to cache
2026-03-12 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687
2026-03-12 20:18:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127057)
2026-03-12 20:18:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee2d90>
2026-03-12 20:18:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/3.jpeg saved to cache
2026-03-12 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687
2026-03-12 20:18:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127057)
2026-03-12 20:18:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c114d50>
2026-03-12 20:18:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/2.jpeg saved to cache
2026-03-12 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687
2026-03-12 20:18:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127057)
2026-03-12 20:18:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607a7d0>
2026-03-12 20:18:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/1.jpeg saved to cache
2026-03-12 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687
2026-03-12 20:18:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127057)
2026-03-12 20:18:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718f490>
2026-03-12 20:18:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/0.jpeg saved to cache
2026-03-12 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687
2026-03-12 20:18:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb0e5c8d-224a-5d26-9bf9-9fbdf014f687, skipping ID generation
2026-03-12 20:18:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687 with scrape type 1
2026-03-12 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb0e5c8d-224a-5d26-9bf9-9fbdf014f687 sending to next pipeline
2026-03-12 20:18:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: fb0e5c8d-224a-5d26-9bf9-9fbdf014f687, identifier: 127057
2026-03-12 20:18:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: fb0e5c8d-224a-5d26-9bf9-9fbdf014f687 with identifier: 127057
2026-03-12 20:18:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: fb0e5c8d-224a-5d26-9bf9-9fbdf014f687 with identifier: 127057
2026-03-12 20:18:37 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: fb0e5c8d-224a-5d26-9bf9-9fbdf014f687 with identifier: 127057 to the API
2026-03-12 20:18:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:18:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:18:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 107,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'fb0e5c8d-224a-5d26-9bf9-9fbdf014f687',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DA73WSJ',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/seat-ibiza-hatchback-2021-10-tsi-110-fr-5dr-127057',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Seat',
'model': 'IBIZA HATCHBACK (2021)',
'odometer': 18211,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47774,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48201,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45502,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41576,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45224,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34470,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45160,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42184,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58827,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb0e5c8d-224a-5d26-9bf9-9fbdf014f687/fb0e5c8d-224a-5d26-9bf9-9fbdf014f687_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94510,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127057/9.jpeg',
'Width': 800}],
'price': 13700.0,
'price_includes_vat': True,
'registration_date': '2023-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Seat IBIZA HATCHBACK (2021) 1.0 TSI 110 FR 5dr',
'transmission': 'manual',
'trim': '1.0 TSI 110 FR 5dr',
'vin': 'VSSZZZKJ3RR007717',
'year': 2023}
2026-03-12 20:18:38 [arval.uk] INFO: Saving data for 127057: {'created_time': 1773346718.230774, 'last_price_update_time': 1773346718.230785}
2026-03-12 20:18:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118146)
2026-03-12 20:18:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f7a88d110>
2026-03-12 20:18:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/9.jpeg saved to cache
2026-03-12 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26
2026-03-12 20:18:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118146)
2026-03-12 20:18:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66050250>
2026-03-12 20:18:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/8.jpeg saved to cache
2026-03-12 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26
2026-03-12 20:18:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/109683)
2026-03-12 20:18:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67661ad0>
2026-03-12 20:18:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/9.jpeg saved to cache
2026-03-12 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c558db4f-e407-53a9-b9b3-30869ab44956
2026-03-12 20:18:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/109683)
2026-03-12 20:18:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763b610>
2026-03-12 20:18:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/8.jpeg saved to cache
2026-03-12 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c558db4f-e407-53a9-b9b3-30869ab44956
2026-03-12 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128780)
2026-03-12 20:18:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c1167d0>
2026-03-12 20:18:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/9.jpeg saved to cache
2026-03-12 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f
2026-03-12 20:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128780)
2026-03-12 20:18:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66050310>
2026-03-12 20:18:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/8.jpeg saved to cache
2026-03-12 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f
2026-03-12 20:18:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128780)
2026-03-12 20:18:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67705c50>
2026-03-12 20:18:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/7.jpeg saved to cache
2026-03-12 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f
2026-03-12 20:18:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128780)
2026-03-12 20:18:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a6690>
2026-03-12 20:18:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/6.jpeg saved to cache
2026-03-12 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f
2026-03-12 20:18:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128780)
2026-03-12 20:18:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66069910>
2026-03-12 20:18:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/5.jpeg saved to cache
2026-03-12 20:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f
2026-03-12 20:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128780)
2026-03-12 20:18:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a5310>
2026-03-12 20:18:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/4.jpeg saved to cache
2026-03-12 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f
2026-03-12 20:18:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128780)
2026-03-12 20:18:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f37690>
2026-03-12 20:18:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/3.jpeg saved to cache
2026-03-12 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f
2026-03-12 20:18:51 [scrapy.extensions.logstats] INFO: Crawled 140 pages (at 3 pages/min), scraped 112 items (at 4 items/min)
2026-03-12 20:18:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128780)
2026-03-12 20:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676459d0>
2026-03-12 20:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/2.jpeg saved to cache
2026-03-12 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f
2026-03-12 20:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128780)
2026-03-12 20:18:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6606b9d0>
2026-03-12 20:18:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/1.jpeg saved to cache
2026-03-12 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f
2026-03-12 20:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128780)
2026-03-12 20:18:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa0d0>
2026-03-12 20:18:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/0.jpeg saved to cache
2026-03-12 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f
2026-03-12 20:18:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56caafd1-7a9e-59ff-b281-cc9a6a38280f, skipping ID generation
2026-03-12 20:18:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f with scrape type 1
2026-03-12 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56caafd1-7a9e-59ff-b281-cc9a6a38280f sending to next pipeline
2026-03-12 20:18:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 56caafd1-7a9e-59ff-b281-cc9a6a38280f, identifier: 128780
2026-03-12 20:18:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 56caafd1-7a9e-59ff-b281-cc9a6a38280f with identifier: 128780
2026-03-12 20:18:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 56caafd1-7a9e-59ff-b281-cc9a6a38280f with identifier: 128780
2026-03-12 20:18:55 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 56caafd1-7a9e-59ff-b281-cc9a6a38280f with identifier: 128780 to the API
2026-03-12 20:18:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:18:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:18:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '0.0L',
'engine_horse_power': 181,
'expiration_date': None,
'fuel_type': 'Electric',
'id': '56caafd1-7a9e-59ff-b281-cc9a6a38280f',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BD72JVY',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/mini-hatchback-electric-2021-135kw-cooper-s-level-3-33kwh-3dr-auto-128780',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Mini',
'model': 'HATCHBACK ELECTRIC (2021)',
'odometer': 28630,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79100,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73074,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88248,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93409,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96514,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70973,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87832,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94008,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68737,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56caafd1-7a9e-59ff-b281-cc9a6a38280f/56caafd1-7a9e-59ff-b281-cc9a6a38280f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94493,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128780/9.jpeg',
'Width': 800}],
'price': 13600.0,
'price_includes_vat': True,
'registration_date': '2022-12-05',
'seats_number': 4,
'seller_name': None,
'title': 'Mini HATCHBACK ELECTRIC (2021) 135kW Cooper S Level 3 33kWh 3dr '
'Auto',
'transmission': 'automatic',
'trim': '135kW Cooper S Level 3 33kWh 3dr Auto',
'vin': 'WMW12DJ0902T80039',
'year': 2022}
2026-03-12 20:18:55 [arval.uk] INFO: Saving data for 128780: {'created_time': 1773346735.714008, 'last_price_update_time': 1773346735.714019}
2026-03-12 20:18:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/109683)
2026-03-12 20:18:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:18:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c179690>
2026-03-12 20:18:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/7.jpeg saved to cache
2026-03-12 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c558db4f-e407-53a9-b9b3-30869ab44956
2026-03-12 20:18:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/109683)
2026-03-12 20:18:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:18:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67644210>
2026-03-12 20:18:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/6.jpeg saved to cache
2026-03-12 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c558db4f-e407-53a9-b9b3-30869ab44956
2026-03-12 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127537> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:18:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/109683)
2026-03-12 20:18:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6a09a11-549a-530f-9f47-93210787c2b3 with identifier: 127537
2026-03-12 20:18:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6a09a11-549a-530f-9f47-93210787c2b3 with scrape type 1
2026-03-12 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6a09a11-549a-530f-9f47-93210787c2b3
2026-03-12 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/0.jpeg not downloaded yet
2026-03-12 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/1.jpeg not downloaded yet
2026-03-12 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/2.jpeg not downloaded yet
2026-03-12 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/3.jpeg not downloaded yet
2026-03-12 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/4.jpeg not downloaded yet
2026-03-12 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/5.jpeg not downloaded yet
2026-03-12 20:18:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a4a10>
2026-03-12 20:18:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/5.jpeg saved to cache
2026-03-12 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c558db4f-e407-53a9-b9b3-30869ab44956
2026-03-12 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/6.jpeg not downloaded yet
2026-03-12 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/7.jpeg not downloaded yet
2026-03-12 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/8.jpeg not downloaded yet
2026-03-12 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/9.jpeg not downloaded yet
2026-03-12 20:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127544> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:18:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:18:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd15d047-267c-536e-b214-b060268ce0a7 with identifier: 127544
2026-03-12 20:18:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd15d047-267c-536e-b214-b060268ce0a7 with scrape type 1
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd15d047-267c-536e-b214-b060268ce0a7
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/0.jpeg not downloaded yet
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/1.jpeg not downloaded yet
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/2.jpeg not downloaded yet
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/3.jpeg not downloaded yet
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/4.jpeg not downloaded yet
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/5.jpeg not downloaded yet
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/6.jpeg not downloaded yet
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/7.jpeg not downloaded yet
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/8.jpeg not downloaded yet
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/9.jpeg not downloaded yet
2026-03-12 20:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/109683)
2026-03-12 20:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125045> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:18:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:18:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5d990>
2026-03-12 20:18:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:18:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:18:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:18:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/4.jpeg saved to cache
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c558db4f-e407-53a9-b9b3-30869ab44956
2026-03-12 20:18:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2718f59b-9b27-5c2c-a497-8e7f82796a32 with identifier: 125045
2026-03-12 20:18:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2718f59b-9b27-5c2c-a497-8e7f82796a32 with scrape type 1
2026-03-12 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2718f59b-9b27-5c2c-a497-8e7f82796a32
2026-03-12 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/0.jpeg not downloaded yet
2026-03-12 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/1.jpeg not downloaded yet
2026-03-12 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/2.jpeg not downloaded yet
2026-03-12 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/3.jpeg not downloaded yet
2026-03-12 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/4.jpeg not downloaded yet
2026-03-12 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/5.jpeg not downloaded yet
2026-03-12 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/6.jpeg not downloaded yet
2026-03-12 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/7.jpeg not downloaded yet
2026-03-12 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/8.jpeg not downloaded yet
2026-03-12 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/9.jpeg not downloaded yet
2026-03-12 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/109683)
2026-03-12 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128157> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67120f90>
2026-03-12 20:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/3.jpeg saved to cache
2026-03-12 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c558db4f-e407-53a9-b9b3-30869ab44956
2026-03-12 20:19:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2779fe07-e3a4-5bcb-8905-62ddc80cee2c with identifier: 128157
2026-03-12 20:19:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c with scrape type 1
2026-03-12 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c
2026-03-12 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/0.jpeg not downloaded yet
2026-03-12 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/1.jpeg not downloaded yet
2026-03-12 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/2.jpeg not downloaded yet
2026-03-12 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/3.jpeg not downloaded yet
2026-03-12 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/4.jpeg not downloaded yet
2026-03-12 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/5.jpeg not downloaded yet
2026-03-12 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/6.jpeg not downloaded yet
2026-03-12 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/7.jpeg not downloaded yet
2026-03-12 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/8.jpeg not downloaded yet
2026-03-12 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/9.jpeg not downloaded yet
2026-03-12 20:19:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/109683)
2026-03-12 20:19:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67638110>
2026-03-12 20:19:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/2.jpeg saved to cache
2026-03-12 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c558db4f-e407-53a9-b9b3-30869ab44956
2026-03-12 20:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/109683)
2026-03-12 20:19:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778f550>
2026-03-12 20:19:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/1.jpeg saved to cache
2026-03-12 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c558db4f-e407-53a9-b9b3-30869ab44956
2026-03-12 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/109683)
2026-03-12 20:19:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c179110>
2026-03-12 20:19:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/0.jpeg saved to cache
2026-03-12 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c558db4f-e407-53a9-b9b3-30869ab44956
2026-03-12 20:19:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c558db4f-e407-53a9-b9b3-30869ab44956, skipping ID generation
2026-03-12 20:19:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c558db4f-e407-53a9-b9b3-30869ab44956 with scrape type 1
2026-03-12 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c558db4f-e407-53a9-b9b3-30869ab44956 sending to next pipeline
2026-03-12 20:19:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: c558db4f-e407-53a9-b9b3-30869ab44956, identifier: 109683
2026-03-12 20:19:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: c558db4f-e407-53a9-b9b3-30869ab44956 with identifier: 109683
2026-03-12 20:19:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: c558db4f-e407-53a9-b9b3-30869ab44956 with identifier: 109683
2026-03-12 20:19:05 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: c558db4f-e407-53a9-b9b3-30869ab44956 with identifier: 109683 to the API
2026-03-12 20:19:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:19:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:19:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 148,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'c558db4f-e407-53a9-b9b3-30869ab44956',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YL21PZH',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/seat-ateca-estate-2020-15-tsi-evo-fr-5dr-109683',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Seat',
'model': 'ATECA ESTATE (2020)',
'odometer': 45591,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69420,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65425,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69670,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53951,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58358,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138082,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102814,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101948,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89990,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c558db4f-e407-53a9-b9b3-30869ab44956/c558db4f-e407-53a9-b9b3-30869ab44956_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75296,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/109683/9.jpeg',
'Width': 1280}],
'price': 13700.0,
'price_includes_vat': True,
'registration_date': '2021-08-01',
'seats_number': 5,
'seller_name': None,
'title': 'Seat ATECA ESTATE (2020) 1.5 TSI EVO FR 5dr',
'transmission': 'manual',
'trim': '1.5 TSI EVO FR 5dr',
'vin': 'VSSZZZ5FZM6572802',
'year': 2021}
2026-03-12 20:19:05 [arval.uk] INFO: Saving data for 109683: {'created_time': 1773346745.771389, 'last_price_update_time': 1773346745.771399}
2026-03-12 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118146)
2026-03-12 20:19:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718d3d0>
2026-03-12 20:19:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/7.jpeg saved to cache
2026-03-12 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26
2026-03-12 20:19:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118146)
2026-03-12 20:19:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712a810>
2026-03-12 20:19:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/6.jpeg saved to cache
2026-03-12 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26
2026-03-12 20:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118146)
2026-03-12 20:19:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aee50>
2026-03-12 20:19:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/5.jpeg saved to cache
2026-03-12 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26
2026-03-12 20:19:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118146)
2026-03-12 20:19:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a74d0>
2026-03-12 20:19:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/4.jpeg saved to cache
2026-03-12 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26
2026-03-12 20:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118146)
2026-03-12 20:19:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67705d10>
2026-03-12 20:19:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/3.jpeg saved to cache
2026-03-12 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26
2026-03-12 20:19:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118146)
2026-03-12 20:19:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16c6d0>
2026-03-12 20:19:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/2.jpeg saved to cache
2026-03-12 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26
2026-03-12 20:19:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118146)
2026-03-12 20:19:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee2f90>
2026-03-12 20:19:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/1.jpeg saved to cache
2026-03-12 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26
2026-03-12 20:19:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118146)
2026-03-12 20:19:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16d350>
2026-03-12 20:19:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/0.jpeg saved to cache
2026-03-12 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26
2026-03-12 20:19:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8f8e820-8a8a-51fb-9011-7de9f2b16c26, skipping ID generation
2026-03-12 20:19:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26 with scrape type 1
2026-03-12 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8f8e820-8a8a-51fb-9011-7de9f2b16c26 sending to next pipeline
2026-03-12 20:19:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: d8f8e820-8a8a-51fb-9011-7de9f2b16c26, identifier: 118146
2026-03-12 20:19:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: d8f8e820-8a8a-51fb-9011-7de9f2b16c26 with identifier: 118146
2026-03-12 20:19:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: d8f8e820-8a8a-51fb-9011-7de9f2b16c26 with identifier: 118146
2026-03-12 20:19:15 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: d8f8e820-8a8a-51fb-9011-7de9f2b16c26 with identifier: 118146 to the API
2026-03-12 20:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:19:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:19:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 122,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'd8f8e820-8a8a-51fb-9011-7de9f2b16c26',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YP72KLU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-puma-hatchback-2019-10-ecoboost-hybrid-mhev-st-line-x-5dr-118146',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'PUMA HATCHBACK (2019)',
'odometer': 24878,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 40,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76295,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74081,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92229,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71194,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56644,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85213,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84615,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69521,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 16630,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8f8e820-8a8a-51fb-9011-7de9f2b16c26/d8f8e820-8a8a-51fb-9011-7de9f2b16c26_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52384,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118146/9.jpeg',
'Width': 800}],
'price': 13900.0,
'price_includes_vat': True,
'registration_date': '2022-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford PUMA HATCHBACK (2019) 1.0 EcoBoost Hybrid mHEV ST-Line X 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost Hybrid mHEV ST-Line X 5dr',
'vin': 'WF02XXERK2NS02593',
'year': 2022}
2026-03-12 20:19:15 [arval.uk] INFO: Saving data for 118146: {'created_time': 1773346755.55081, 'last_price_update_time': 1773346755.550821}
2026-03-12 20:19:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127537)
2026-03-12 20:19:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16e650>
2026-03-12 20:19:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/9.jpeg saved to cache
2026-03-12 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6a09a11-549a-530f-9f47-93210787c2b3
2026-03-12 20:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127544)
2026-03-12 20:19:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6602c750>
2026-03-12 20:19:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/9.jpeg saved to cache
2026-03-12 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd15d047-267c-536e-b214-b060268ce0a7
2026-03-12 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127544)
2026-03-12 20:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b6f50>
2026-03-12 20:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/8.jpeg saved to cache
2026-03-12 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd15d047-267c-536e-b214-b060268ce0a7
2026-03-12 20:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125045)
2026-03-12 20:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a4d50>
2026-03-12 20:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/9.jpeg saved to cache
2026-03-12 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2718f59b-9b27-5c2c-a497-8e7f82796a32
2026-03-12 20:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125045)
2026-03-12 20:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b5b10>
2026-03-12 20:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/8.jpeg saved to cache
2026-03-12 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2718f59b-9b27-5c2c-a497-8e7f82796a32
2026-03-12 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128157)
2026-03-12 20:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef0150>
2026-03-12 20:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/9.jpeg saved to cache
2026-03-12 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c
2026-03-12 20:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128157)
2026-03-12 20:19:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66050890>
2026-03-12 20:19:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/8.jpeg saved to cache
2026-03-12 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c
2026-03-12 20:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128157)
2026-03-12 20:19:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6602da50>
2026-03-12 20:19:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/7.jpeg saved to cache
2026-03-12 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c
2026-03-12 20:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128157)
2026-03-12 20:19:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677e9cd0>
2026-03-12 20:19:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/6.jpeg saved to cache
2026-03-12 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c
2026-03-12 20:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128157)
2026-03-12 20:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5e990>
2026-03-12 20:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/5.jpeg saved to cache
2026-03-12 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c
2026-03-12 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128157)
2026-03-12 20:19:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a8650>
2026-03-12 20:19:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/4.jpeg saved to cache
2026-03-12 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c
2026-03-12 20:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128157)
2026-03-12 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c178d10>
2026-03-12 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/3.jpeg saved to cache
2026-03-12 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c
2026-03-12 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128157)
2026-03-12 20:19:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f93d0>
2026-03-12 20:19:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/2.jpeg saved to cache
2026-03-12 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c
2026-03-12 20:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128157)
2026-03-12 20:19:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5e610>
2026-03-12 20:19:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/1.jpeg saved to cache
2026-03-12 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c
2026-03-12 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128157)
2026-03-12 20:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67121510>
2026-03-12 20:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/0.jpeg saved to cache
2026-03-12 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c
2026-03-12 20:19:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2779fe07-e3a4-5bcb-8905-62ddc80cee2c, skipping ID generation
2026-03-12 20:19:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c with scrape type 1
2026-03-12 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2779fe07-e3a4-5bcb-8905-62ddc80cee2c sending to next pipeline
2026-03-12 20:19:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 2779fe07-e3a4-5bcb-8905-62ddc80cee2c, identifier: 128157
2026-03-12 20:19:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 2779fe07-e3a4-5bcb-8905-62ddc80cee2c with identifier: 128157
2026-03-12 20:19:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 2779fe07-e3a4-5bcb-8905-62ddc80cee2c with identifier: 128157
2026-03-12 20:19:32 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 2779fe07-e3a4-5bcb-8905-62ddc80cee2c with identifier: 128157 to the API
2026-03-12 20:19:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:19:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:19:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 128,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '2779fe07-e3a4-5bcb-8905-62ddc80cee2c',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DL23YLF',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/vauxhall-corsa-hatchback-2019-12-turbo-gs-5dr-auto-128157',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Vauxhall',
'model': 'CORSA HATCHBACK (2019)',
'odometer': 15157,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56885,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52394,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55326,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52566,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53798,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48192,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54840,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52739,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44962,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2779fe07-e3a4-5bcb-8905-62ddc80cee2c/2779fe07-e3a4-5bcb-8905-62ddc80cee2c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79446,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128157/9.jpeg',
'Width': 800}],
'price': 13400.0,
'price_includes_vat': True,
'registration_date': '2023-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall CORSA HATCHBACK (2019) 1.2 Turbo GS 5dr Auto',
'transmission': 'automatic',
'trim': '1.2 Turbo GS 5dr Auto',
'vin': 'VXKUPHNSSP4202384',
'year': 2023}
2026-03-12 20:19:32 [arval.uk] INFO: Saving data for 128157: {'created_time': 1773346772.881663, 'last_price_update_time': 1773346772.881674}
2026-03-12 20:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125045)
2026-03-12 20:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ab4d0>
2026-03-12 20:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/7.jpeg saved to cache
2026-03-12 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2718f59b-9b27-5c2c-a497-8e7f82796a32
2026-03-12 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125045)
2026-03-12 20:19:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676461d0>
2026-03-12 20:19:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/6.jpeg saved to cache
2026-03-12 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2718f59b-9b27-5c2c-a497-8e7f82796a32
2026-03-12 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125045)
2026-03-12 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6717a090>
2026-03-12 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/5.jpeg saved to cache
2026-03-12 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2718f59b-9b27-5c2c-a497-8e7f82796a32
2026-03-12 20:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125045)
2026-03-12 20:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6d3fa0d0>
2026-03-12 20:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/4.jpeg saved to cache
2026-03-12 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2718f59b-9b27-5c2c-a497-8e7f82796a32
2026-03-12 20:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125045)
2026-03-12 20:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb77d0>
2026-03-12 20:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/3.jpeg saved to cache
2026-03-12 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2718f59b-9b27-5c2c-a497-8e7f82796a32
2026-03-12 20:19:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125045)
2026-03-12 20:19:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2e9ed0>
2026-03-12 20:19:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/2.jpeg saved to cache
2026-03-12 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2718f59b-9b27-5c2c-a497-8e7f82796a32
2026-03-12 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125045)
2026-03-12 20:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67179410>
2026-03-12 20:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/1.jpeg saved to cache
2026-03-12 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2718f59b-9b27-5c2c-a497-8e7f82796a32
2026-03-12 20:19:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125045)
2026-03-12 20:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66052390>
2026-03-12 20:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/0.jpeg saved to cache
2026-03-12 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2718f59b-9b27-5c2c-a497-8e7f82796a32
2026-03-12 20:19:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2718f59b-9b27-5c2c-a497-8e7f82796a32, skipping ID generation
2026-03-12 20:19:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2718f59b-9b27-5c2c-a497-8e7f82796a32 with scrape type 1
2026-03-12 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2718f59b-9b27-5c2c-a497-8e7f82796a32 sending to next pipeline
2026-03-12 20:19:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 2718f59b-9b27-5c2c-a497-8e7f82796a32, identifier: 125045
2026-03-12 20:19:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 2718f59b-9b27-5c2c-a497-8e7f82796a32 with identifier: 125045
2026-03-12 20:19:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 2718f59b-9b27-5c2c-a497-8e7f82796a32 with identifier: 125045
2026-03-12 20:19:42 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 2718f59b-9b27-5c2c-a497-8e7f82796a32 with identifier: 125045 to the API
2026-03-12 20:19:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:19:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:19:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 99,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '2718f59b-9b27-5c2c-a497-8e7f82796a32',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YP72WHM',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-fiesta-hatchback-2021-10-ecoboost-st-line-x-5dr-125045',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'FIESTA HATCHBACK (2021)',
'odometer': 19270,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48128,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46977,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47600,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40571,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45037,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38563,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40774,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47181,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41625,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2718f59b-9b27-5c2c-a497-8e7f82796a32/2718f59b-9b27-5c2c-a497-8e7f82796a32_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47373,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125045/9.jpeg',
'Width': 800}],
'price': 13500.0,
'price_includes_vat': True,
'registration_date': '2022-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'Ford FIESTA HATCHBACK (2021) 1.0 EcoBoost ST-Line X 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost ST-Line X 5dr',
'vin': 'WF0JXXGAHJNB62967',
'year': 2022}
2026-03-12 20:19:42 [arval.uk] INFO: Saving data for 125045: {'created_time': 1773346782.73059, 'last_price_update_time': 1773346782.730599}
2026-03-12 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127544)
2026-03-12 20:19:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2e8d90>
2026-03-12 20:19:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/7.jpeg saved to cache
2026-03-12 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd15d047-267c-536e-b214-b060268ce0a7
2026-03-12 20:19:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127544)
2026-03-12 20:19:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a61d0>
2026-03-12 20:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/6.jpeg saved to cache
2026-03-12 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd15d047-267c-536e-b214-b060268ce0a7
2026-03-12 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127544)
2026-03-12 20:19:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f671230d0>
2026-03-12 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/5.jpeg saved to cache
2026-03-12 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd15d047-267c-536e-b214-b060268ce0a7
2026-03-12 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126269> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:19:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8a82b7-c007-5528-8cef-13d0927b3fc3 with identifier: 126269
2026-03-12 20:19:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3 with scrape type 1
2026-03-12 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3
2026-03-12 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/0.jpeg not downloaded yet
2026-03-12 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/1.jpeg not downloaded yet
2026-03-12 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/2.jpeg not downloaded yet
2026-03-12 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/3.jpeg not downloaded yet
2026-03-12 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/4.jpeg not downloaded yet
2026-03-12 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/5.jpeg not downloaded yet
2026-03-12 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/6.jpeg not downloaded yet
2026-03-12 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/7.jpeg not downloaded yet
2026-03-12 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/8.jpeg not downloaded yet
2026-03-12 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/9.jpeg not downloaded yet
2026-03-12 20:19:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127544)
2026-03-12 20:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f361d0>
2026-03-12 20:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/4.jpeg saved to cache
2026-03-12 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd15d047-267c-536e-b214-b060268ce0a7
2026-03-12 20:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116313> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:19:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1360845b-d225-575d-bfc0-cb79aff936b6 with identifier: 116313
2026-03-12 20:19:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1360845b-d225-575d-bfc0-cb79aff936b6 with scrape type 1
2026-03-12 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1360845b-d225-575d-bfc0-cb79aff936b6
2026-03-12 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/0.jpeg not downloaded yet
2026-03-12 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/1.jpeg not downloaded yet
2026-03-12 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/2.jpeg not downloaded yet
2026-03-12 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/3.jpeg not downloaded yet
2026-03-12 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/4.jpeg not downloaded yet
2026-03-12 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/5.jpeg not downloaded yet
2026-03-12 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/6.jpeg not downloaded yet
2026-03-12 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/7.jpeg not downloaded yet
2026-03-12 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/8.jpeg not downloaded yet
2026-03-12 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/9.jpeg not downloaded yet
2026-03-12 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124139> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127544)
2026-03-12 20:19:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43606eec-9e87-5ad7-a87f-57d9599d3bb4 with identifier: 124139
2026-03-12 20:19:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4 with scrape type 1
2026-03-12 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4
2026-03-12 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/0.jpeg not downloaded yet
2026-03-12 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/1.jpeg not downloaded yet
2026-03-12 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/2.jpeg not downloaded yet
2026-03-12 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/3.jpeg not downloaded yet
2026-03-12 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/4.jpeg not downloaded yet
2026-03-12 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/5.jpeg not downloaded yet
2026-03-12 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/6.jpeg not downloaded yet
2026-03-12 20:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c17b890>
2026-03-12 20:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/3.jpeg saved to cache
2026-03-12 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd15d047-267c-536e-b214-b060268ce0a7
2026-03-12 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/7.jpeg not downloaded yet
2026-03-12 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/8.jpeg not downloaded yet
2026-03-12 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/9.jpeg not downloaded yet
2026-03-12 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127544)
2026-03-12 20:19:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee2c90>
2026-03-12 20:19:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/2.jpeg saved to cache
2026-03-12 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd15d047-267c-536e-b214-b060268ce0a7
2026-03-12 20:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127544)
2026-03-12 20:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb6ed0>
2026-03-12 20:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/1.jpeg saved to cache
2026-03-12 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd15d047-267c-536e-b214-b060268ce0a7
2026-03-12 20:19:51 [scrapy.extensions.logstats] INFO: Crawled 147 pages (at 7 pages/min), scraped 117 items (at 5 items/min)
2026-03-12 20:19:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:19:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127544)
2026-03-12 20:19:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee2950>
2026-03-12 20:19:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/0.jpeg saved to cache
2026-03-12 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd15d047-267c-536e-b214-b060268ce0a7
2026-03-12 20:19:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd15d047-267c-536e-b214-b060268ce0a7, skipping ID generation
2026-03-12 20:19:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd15d047-267c-536e-b214-b060268ce0a7 with scrape type 1
2026-03-12 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd15d047-267c-536e-b214-b060268ce0a7 sending to next pipeline
2026-03-12 20:19:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: bd15d047-267c-536e-b214-b060268ce0a7, identifier: 127544
2026-03-12 20:19:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: bd15d047-267c-536e-b214-b060268ce0a7 with identifier: 127544
2026-03-12 20:19:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: bd15d047-267c-536e-b214-b060268ce0a7 with identifier: 127544
2026-03-12 20:19:52 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: bd15d047-267c-536e-b214-b060268ce0a7 with identifier: 127544 to the API
2026-03-12 20:19:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:19:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:19:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 88,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'bd15d047-267c-536e-b214-b060268ce0a7',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DV72XML',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/mazda-mazda2-hatchback-2019-15-e-skyactiv-g-gt-sport-5dr-127544',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Mazda',
'model': 'MAZDA2 HATCHBACK (2019)',
'odometer': 10446,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86568,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70332,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79132,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95605,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77196,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61964,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77089,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103557,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66703,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd15d047-267c-536e-b214-b060268ce0a7/bd15d047-267c-536e-b214-b060268ce0a7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98903,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127544/9.jpeg',
'Width': 800}],
'price': 13600.0,
'price_includes_vat': True,
'registration_date': '2022-10-24',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda MAZDA2 HATCHBACK (2019) 1.5 e-Skyactiv G GT Sport 5dr',
'transmission': 'manual',
'trim': '1.5 e-Skyactiv G GT Sport 5dr',
'vin': 'JMZDJ6HC601364028',
'year': 2022}
2026-03-12 20:19:53 [arval.uk] INFO: Saving data for 127544: {'created_time': 1773346793.189976, 'last_price_update_time': 1773346793.189988}
2026-03-12 20:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127537)
2026-03-12 20:19:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66074f90>
2026-03-12 20:19:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/8.jpeg saved to cache
2026-03-12 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6a09a11-549a-530f-9f47-93210787c2b3
2026-03-12 20:19:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127537)
2026-03-12 20:19:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b4d50>
2026-03-12 20:19:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/7.jpeg saved to cache
2026-03-12 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6a09a11-549a-530f-9f47-93210787c2b3
2026-03-12 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127537)
2026-03-12 20:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb1950>
2026-03-12 20:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/6.jpeg saved to cache
2026-03-12 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6a09a11-549a-530f-9f47-93210787c2b3
2026-03-12 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127537)
2026-03-12 20:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67646050>
2026-03-12 20:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/5.jpeg saved to cache
2026-03-12 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6a09a11-549a-530f-9f47-93210787c2b3
2026-03-12 20:19:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127537)
2026-03-12 20:19:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:19:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67639a10>
2026-03-12 20:19:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:19:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:19:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:19:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/4.jpeg saved to cache
2026-03-12 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6a09a11-549a-530f-9f47-93210787c2b3
2026-03-12 20:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127537)
2026-03-12 20:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66077b90>
2026-03-12 20:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/3.jpeg saved to cache
2026-03-12 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6a09a11-549a-530f-9f47-93210787c2b3
2026-03-12 20:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127537)
2026-03-12 20:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676606d0>
2026-03-12 20:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/2.jpeg saved to cache
2026-03-12 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6a09a11-549a-530f-9f47-93210787c2b3
2026-03-12 20:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127537)
2026-03-12 20:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66075bd0>
2026-03-12 20:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/1.jpeg saved to cache
2026-03-12 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6a09a11-549a-530f-9f47-93210787c2b3
2026-03-12 20:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127537)
2026-03-12 20:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677ebb50>
2026-03-12 20:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/0.jpeg saved to cache
2026-03-12 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6a09a11-549a-530f-9f47-93210787c2b3
2026-03-12 20:20:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6a09a11-549a-530f-9f47-93210787c2b3, skipping ID generation
2026-03-12 20:20:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6a09a11-549a-530f-9f47-93210787c2b3 with scrape type 1
2026-03-12 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6a09a11-549a-530f-9f47-93210787c2b3 sending to next pipeline
2026-03-12 20:20:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: b6a09a11-549a-530f-9f47-93210787c2b3, identifier: 127537
2026-03-12 20:20:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: b6a09a11-549a-530f-9f47-93210787c2b3 with identifier: 127537
2026-03-12 20:20:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: b6a09a11-549a-530f-9f47-93210787c2b3 with identifier: 127537
2026-03-12 20:20:04 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: b6a09a11-549a-530f-9f47-93210787c2b3 with identifier: 127537 to the API
2026-03-12 20:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:20:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:20:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 128,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'b6a09a11-549a-530f-9f47-93210787c2b3',
'is_damaged': False,
'is_operable': True,
'license_plate': 'WR72FPK',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/vauxhall-mokka-hatchback-2020-12-turbo-gs-line-5dr-127537',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Vauxhall',
'model': 'MOKKA HATCHBACK (2020)',
'odometer': 19188,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48689,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43387,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48160,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50599,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43459,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50480,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45815,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59268,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42396,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6a09a11-549a-530f-9f47-93210787c2b3/b6a09a11-549a-530f-9f47-93210787c2b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29192,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127537/9.jpeg',
'Width': 800}],
'price': 13500.0,
'price_includes_vat': True,
'registration_date': '2022-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall MOKKA HATCHBACK (2020) 1.2 Turbo GS Line 5dr',
'transmission': 'manual',
'trim': '1.2 Turbo GS Line 5dr',
'vin': 'VXKUSHNSKNW080226',
'year': 2022}
2026-03-12 20:20:04 [arval.uk] INFO: Saving data for 127537: {'created_time': 1773346804.683605, 'last_price_update_time': 1773346804.683614}
2026-03-12 20:20:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126269)
2026-03-12 20:20:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6710fc90>
2026-03-12 20:20:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/9.jpeg saved to cache
2026-03-12 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3
2026-03-12 20:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126269)
2026-03-12 20:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb2210>
2026-03-12 20:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/8.jpeg saved to cache
2026-03-12 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3
2026-03-12 20:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116313)
2026-03-12 20:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb6650>
2026-03-12 20:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/9.jpeg saved to cache
2026-03-12 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1360845b-d225-575d-bfc0-cb79aff936b6
2026-03-12 20:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116313)
2026-03-12 20:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f36d10>
2026-03-12 20:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/8.jpeg saved to cache
2026-03-12 20:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1360845b-d225-575d-bfc0-cb79aff936b6
2026-03-12 20:20:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124139)
2026-03-12 20:20:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbeec10>
2026-03-12 20:20:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/9.jpeg saved to cache
2026-03-12 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4
2026-03-12 20:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124139)
2026-03-12 20:20:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbcdcd0>
2026-03-12 20:20:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/8.jpeg saved to cache
2026-03-12 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4
2026-03-12 20:20:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124139)
2026-03-12 20:20:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbec950>
2026-03-12 20:20:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/7.jpeg saved to cache
2026-03-12 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4
2026-03-12 20:20:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124139)
2026-03-12 20:20:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763b010>
2026-03-12 20:20:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/6.jpeg saved to cache
2026-03-12 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4
2026-03-12 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124139)
2026-03-12 20:20:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712a7d0>
2026-03-12 20:20:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/5.jpeg saved to cache
2026-03-12 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4
2026-03-12 20:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124139)
2026-03-12 20:20:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67628a10>
2026-03-12 20:20:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/4.jpeg saved to cache
2026-03-12 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4
2026-03-12 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124139)
2026-03-12 20:20:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67123110>
2026-03-12 20:20:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/3.jpeg saved to cache
2026-03-12 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4
2026-03-12 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124139)
2026-03-12 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67198b50>
2026-03-12 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/2.jpeg saved to cache
2026-03-12 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4
2026-03-12 20:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124139)
2026-03-12 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67123a90>
2026-03-12 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/1.jpeg saved to cache
2026-03-12 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4
2026-03-12 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124139)
2026-03-12 20:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a8bd0>
2026-03-12 20:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/0.jpeg saved to cache
2026-03-12 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4
2026-03-12 20:20:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43606eec-9e87-5ad7-a87f-57d9599d3bb4, skipping ID generation
2026-03-12 20:20:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4 with scrape type 1
2026-03-12 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43606eec-9e87-5ad7-a87f-57d9599d3bb4 sending to next pipeline
2026-03-12 20:20:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 43606eec-9e87-5ad7-a87f-57d9599d3bb4, identifier: 124139
2026-03-12 20:20:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 43606eec-9e87-5ad7-a87f-57d9599d3bb4 with identifier: 124139
2026-03-12 20:20:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 43606eec-9e87-5ad7-a87f-57d9599d3bb4 with identifier: 124139
2026-03-12 20:20:23 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 43606eec-9e87-5ad7-a87f-57d9599d3bb4 with identifier: 124139 to the API
2026-03-12 20:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:20:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:20:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 107,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '43606eec-9e87-5ad7-a87f-57d9599d3bb4',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YH72TSO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/seat-ibiza-hatchback-2021-10-tsi-110-xcellence-5dr-124139',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Seat',
'model': 'IBIZA HATCHBACK (2021)',
'odometer': 19420,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59843,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58854,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51255,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43882,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48866,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168145,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81388,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82839,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94125,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43606eec-9e87-5ad7-a87f-57d9599d3bb4/43606eec-9e87-5ad7-a87f-57d9599d3bb4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91772,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/124139/9.jpeg',
'Width': 1280}],
'price': 13100.0,
'price_includes_vat': True,
'registration_date': '2022-10-23',
'seats_number': 5,
'seller_name': None,
'title': 'Seat IBIZA HATCHBACK (2021) 1.0 TSI 110 Xcellence 5dr',
'transmission': 'manual',
'trim': '1.0 TSI 110 Xcellence 5dr',
'vin': 'VSSZZZKJ0PR006991',
'year': 2022}
2026-03-12 20:20:23 [arval.uk] INFO: Saving data for 124139: {'created_time': 1773346823.507023, 'last_price_update_time': 1773346823.507033}
2026-03-12 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116313)
2026-03-12 20:20:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66079cd0>
2026-03-12 20:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/7.jpeg saved to cache
2026-03-12 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1360845b-d225-575d-bfc0-cb79aff936b6
2026-03-12 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116313)
2026-03-12 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67645910>
2026-03-12 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/6.jpeg saved to cache
2026-03-12 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1360845b-d225-575d-bfc0-cb79aff936b6
2026-03-12 20:20:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:20:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122960> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:20:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2784341e-ca4e-5867-bd7b-3d76e9fc0cea with identifier: 122960
2026-03-12 20:20:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea with scrape type 1
2026-03-12 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea
2026-03-12 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/0.jpeg not downloaded yet
2026-03-12 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/1.jpeg not downloaded yet
2026-03-12 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/2.jpeg not downloaded yet
2026-03-12 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/3.jpeg not downloaded yet
2026-03-12 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/4.jpeg not downloaded yet
2026-03-12 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/5.jpeg not downloaded yet
2026-03-12 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/6.jpeg not downloaded yet
2026-03-12 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/7.jpeg not downloaded yet
2026-03-12 20:20:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116313)
2026-03-12 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/8.jpeg not downloaded yet
2026-03-12 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/9.jpeg not downloaded yet
2026-03-12 20:20:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762a050>
2026-03-12 20:20:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/5.jpeg saved to cache
2026-03-12 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1360845b-d225-575d-bfc0-cb79aff936b6
2026-03-12 20:20:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122159> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:20:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98996b45-bccc-544f-9f7c-39304b16dd98 with identifier: 122159
2026-03-12 20:20:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98996b45-bccc-544f-9f7c-39304b16dd98 with scrape type 1
2026-03-12 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98996b45-bccc-544f-9f7c-39304b16dd98
2026-03-12 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/0.jpeg not downloaded yet
2026-03-12 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/1.jpeg not downloaded yet
2026-03-12 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/2.jpeg not downloaded yet
2026-03-12 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/3.jpeg not downloaded yet
2026-03-12 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/4.jpeg not downloaded yet
2026-03-12 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/5.jpeg not downloaded yet
2026-03-12 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/6.jpeg not downloaded yet
2026-03-12 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/7.jpeg not downloaded yet
2026-03-12 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/8.jpeg not downloaded yet
2026-03-12 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/9.jpeg not downloaded yet
2026-03-12 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116313)
2026-03-12 20:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c1473d0>
2026-03-12 20:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/4.jpeg saved to cache
2026-03-12 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1360845b-d225-575d-bfc0-cb79aff936b6
2026-03-12 20:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127046> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:20:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98f31db4-c8ca-50ed-ad33-2d2eb0452c02 with identifier: 127046
2026-03-12 20:20:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02 with scrape type 1
2026-03-12 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02
2026-03-12 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/0.jpeg not downloaded yet
2026-03-12 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/1.jpeg not downloaded yet
2026-03-12 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/2.jpeg not downloaded yet
2026-03-12 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/3.jpeg not downloaded yet
2026-03-12 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/4.jpeg not downloaded yet
2026-03-12 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/5.jpeg not downloaded yet
2026-03-12 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/6.jpeg not downloaded yet
2026-03-12 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/7.jpeg not downloaded yet
2026-03-12 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/8.jpeg not downloaded yet
2026-03-12 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/9.jpeg not downloaded yet
2026-03-12 20:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116313)
2026-03-12 20:20:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c12fc10>
2026-03-12 20:20:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/3.jpeg saved to cache
2026-03-12 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1360845b-d225-575d-bfc0-cb79aff936b6
2026-03-12 20:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116313)
2026-03-12 20:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f47b10>
2026-03-12 20:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/2.jpeg saved to cache
2026-03-12 20:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1360845b-d225-575d-bfc0-cb79aff936b6
2026-03-12 20:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116313)
2026-03-12 20:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f37050>
2026-03-12 20:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/1.jpeg saved to cache
2026-03-12 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1360845b-d225-575d-bfc0-cb79aff936b6
2026-03-12 20:20:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116313)
2026-03-12 20:20:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aee10>
2026-03-12 20:20:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/0.jpeg saved to cache
2026-03-12 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1360845b-d225-575d-bfc0-cb79aff936b6
2026-03-12 20:20:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1360845b-d225-575d-bfc0-cb79aff936b6, skipping ID generation
2026-03-12 20:20:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1360845b-d225-575d-bfc0-cb79aff936b6 with scrape type 1
2026-03-12 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1360845b-d225-575d-bfc0-cb79aff936b6 sending to next pipeline
2026-03-12 20:20:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 1360845b-d225-575d-bfc0-cb79aff936b6, identifier: 116313
2026-03-12 20:20:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 1360845b-d225-575d-bfc0-cb79aff936b6 with identifier: 116313
2026-03-12 20:20:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 1360845b-d225-575d-bfc0-cb79aff936b6 with identifier: 116313
2026-03-12 20:20:31 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 1360845b-d225-575d-bfc0-cb79aff936b6 with identifier: 116313 to the API
2026-03-12 20:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:20:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:20:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 111,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '1360845b-d225-575d-bfc0-cb79aff936b6',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DS22WCP',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/nissan-juke-hatchback-2019-10-dig-t-114-tekna-5dr-116313',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Nissan',
'model': 'JUKE HATCHBACK (2019)',
'odometer': 20325,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77086,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75109,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88185,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69400,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66974,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84936,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81920,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76997,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84554,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1360845b-d225-575d-bfc0-cb79aff936b6/1360845b-d225-575d-bfc0-cb79aff936b6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51334,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116313/9.jpeg',
'Width': 800}],
'price': 13400.0,
'price_includes_vat': True,
'registration_date': '2022-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan JUKE HATCHBACK (2019) 1.0 DiG-T 114 Tekna+ 5dr',
'transmission': 'manual',
'trim': '1.0 DiG-T 114 Tekna+ 5dr',
'vin': 'SJNFAAF16U1184228',
'year': 2022}
2026-03-12 20:20:32 [arval.uk] INFO: Saving data for 116313: {'created_time': 1773346832.421444, 'last_price_update_time': 1773346832.421453}
2026-03-12 20:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126269)
2026-03-12 20:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb26d0>
2026-03-12 20:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/7.jpeg saved to cache
2026-03-12 20:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3
2026-03-12 20:20:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126269)
2026-03-12 20:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660aa010>
2026-03-12 20:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/6.jpeg saved to cache
2026-03-12 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3
2026-03-12 20:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126269)
2026-03-12 20:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676635d0>
2026-03-12 20:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/5.jpeg saved to cache
2026-03-12 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3
2026-03-12 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126269)
2026-03-12 20:20:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f450d0>
2026-03-12 20:20:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/4.jpeg saved to cache
2026-03-12 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3
2026-03-12 20:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126269)
2026-03-12 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677eb590>
2026-03-12 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/3.jpeg saved to cache
2026-03-12 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3
2026-03-12 20:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126269)
2026-03-12 20:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67765210>
2026-03-12 20:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/2.jpeg saved to cache
2026-03-12 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3
2026-03-12 20:20:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126269)
2026-03-12 20:20:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677e9390>
2026-03-12 20:20:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/1.jpeg saved to cache
2026-03-12 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3
2026-03-12 20:20:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126269)
2026-03-12 20:20:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677807d0>
2026-03-12 20:20:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:20:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/0.jpeg saved to cache
2026-03-12 20:20:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3
2026-03-12 20:20:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a8a82b7-c007-5528-8cef-13d0927b3fc3, skipping ID generation
2026-03-12 20:20:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3 with scrape type 1
2026-03-12 20:20:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a8a82b7-c007-5528-8cef-13d0927b3fc3 sending to next pipeline
2026-03-12 20:20:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 2a8a82b7-c007-5528-8cef-13d0927b3fc3, identifier: 126269
2026-03-12 20:20:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 2a8a82b7-c007-5528-8cef-13d0927b3fc3 with identifier: 126269
2026-03-12 20:20:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 2a8a82b7-c007-5528-8cef-13d0927b3fc3 with identifier: 126269
2026-03-12 20:20:41 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 2a8a82b7-c007-5528-8cef-13d0927b3fc3 with identifier: 126269 to the API
2026-03-12 20:20:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:20:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:20:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 122,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '2a8a82b7-c007-5528-8cef-13d0927b3fc3',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YS72RVC',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-fiesta-hatchback-2021-10-ecoboost-hybrid-mhev-125-st-line-5dr-126269',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'FIESTA HATCHBACK (2021)',
'odometer': 12170,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80505,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84594,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88916,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99119,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76294,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65835,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82051,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102508,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64700,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a8a82b7-c007-5528-8cef-13d0927b3fc3/2a8a82b7-c007-5528-8cef-13d0927b3fc3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101305,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126269/9.jpeg',
'Width': 800}],
'price': 13400.0,
'price_includes_vat': True,
'registration_date': '2022-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Ford FIESTA HATCHBACK (2021) 1.0 EcoBoost Hybrid mHEV 125 ST-Line '
'5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost Hybrid mHEV 125 ST-Line 5dr',
'vin': 'WF0JXXGAHJNB68257',
'year': 2022}
2026-03-12 20:20:42 [arval.uk] INFO: Saving data for 126269: {'created_time': 1773346842.008594, 'last_price_update_time': 1773346842.008603}
2026-03-12 20:20:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122960)
2026-03-12 20:20:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbde510>
2026-03-12 20:20:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/7.jpeg saved to cache
2026-03-12 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea
2026-03-12 20:20:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122960)
2026-03-12 20:20:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f37590>
2026-03-12 20:20:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/9.jpeg saved to cache
2026-03-12 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea
2026-03-12 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122159)
2026-03-12 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16fa50>
2026-03-12 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/9.jpeg saved to cache
2026-03-12 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98996b45-bccc-544f-9f7c-39304b16dd98
2026-03-12 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122159)
2026-03-12 20:20:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67646dd0>
2026-03-12 20:20:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/8.jpeg saved to cache
2026-03-12 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98996b45-bccc-544f-9f7c-39304b16dd98
2026-03-12 20:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127046)
2026-03-12 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f79490>
2026-03-12 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/9.jpeg saved to cache
2026-03-12 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02
2026-03-12 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127046)
2026-03-12 20:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67638f90>
2026-03-12 20:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/8.jpeg saved to cache
2026-03-12 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02
2026-03-12 20:20:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127046)
2026-03-12 20:20:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7a950>
2026-03-12 20:20:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/7.jpeg saved to cache
2026-03-12 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02
2026-03-12 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127046)
2026-03-12 20:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c12f750>
2026-03-12 20:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/6.jpeg saved to cache
2026-03-12 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02
2026-03-12 20:20:51 [scrapy.extensions.logstats] INFO: Crawled 150 pages (at 3 pages/min), scraped 122 items (at 5 items/min)
2026-03-12 20:20:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127046)
2026-03-12 20:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660788d0>
2026-03-12 20:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/5.jpeg saved to cache
2026-03-12 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02
2026-03-12 20:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127046)
2026-03-12 20:20:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676448d0>
2026-03-12 20:20:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/4.jpeg saved to cache
2026-03-12 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02
2026-03-12 20:20:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127046)
2026-03-12 20:20:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66079b90>
2026-03-12 20:20:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/3.jpeg saved to cache
2026-03-12 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02
2026-03-12 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127046)
2026-03-12 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67629610>
2026-03-12 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/2.jpeg saved to cache
2026-03-12 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02
2026-03-12 20:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127046)
2026-03-12 20:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbde510>
2026-03-12 20:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/1.jpeg saved to cache
2026-03-12 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02
2026-03-12 20:20:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127046)
2026-03-12 20:20:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:20:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778fe50>
2026-03-12 20:20:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:20:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:20:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:20:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/0.jpeg saved to cache
2026-03-12 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02
2026-03-12 20:20:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98f31db4-c8ca-50ed-ad33-2d2eb0452c02, skipping ID generation
2026-03-12 20:20:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02 with scrape type 1
2026-03-12 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98f31db4-c8ca-50ed-ad33-2d2eb0452c02 sending to next pipeline
2026-03-12 20:20:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 98f31db4-c8ca-50ed-ad33-2d2eb0452c02, identifier: 127046
2026-03-12 20:20:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 98f31db4-c8ca-50ed-ad33-2d2eb0452c02 with identifier: 127046
2026-03-12 20:20:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 98f31db4-c8ca-50ed-ad33-2d2eb0452c02 with identifier: 127046
2026-03-12 20:20:58 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 98f31db4-c8ca-50ed-ad33-2d2eb0452c02 with identifier: 127046 to the API
2026-03-12 20:20:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:21:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:21:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 111,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '98f31db4-c8ca-50ed-ad33-2d2eb0452c02',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DS72RYM',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/nissan-juke-hatchback-2019-10-dig-t-114-n-connecta-5dr-127046',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Nissan',
'model': 'JUKE HATCHBACK (2019)',
'odometer': 14788,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78642,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76832,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78546,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77607,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76113,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77207,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63679,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103198,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61485,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98f31db4-c8ca-50ed-ad33-2d2eb0452c02/98f31db4-c8ca-50ed-ad33-2d2eb0452c02_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46949,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127046/9.jpeg',
'Width': 800}],
'price': 12900.0,
'price_includes_vat': True,
'registration_date': '2022-12-21',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan JUKE HATCHBACK (2019) 1.0 DiG-T 114 N-Connecta 5dr',
'transmission': 'manual',
'trim': '1.0 DiG-T 114 N-Connecta 5dr',
'vin': 'SJNFAAF16U1208156',
'year': 2022}
2026-03-12 20:21:00 [arval.uk] INFO: Saving data for 127046: {'created_time': 1773346860.170109, 'last_price_update_time': 1773346860.170121}
2026-03-12 20:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122159)
2026-03-12 20:21:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712dcd0>
2026-03-12 20:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/7.jpeg saved to cache
2026-03-12 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98996b45-bccc-544f-9f7c-39304b16dd98
2026-03-12 20:21:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122159)
2026-03-12 20:21:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:21:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123931> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:21:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67646410>
2026-03-12 20:21:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/6.jpeg saved to cache
2026-03-12 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98996b45-bccc-544f-9f7c-39304b16dd98
2026-03-12 20:21:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1709ae9d-b60e-591a-a9e4-ec8087e084a0 with identifier: 123931
2026-03-12 20:21:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0 with scrape type 1
2026-03-12 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0
2026-03-12 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/0.jpeg not downloaded yet
2026-03-12 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/1.jpeg not downloaded yet
2026-03-12 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/2.jpeg not downloaded yet
2026-03-12 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/3.jpeg not downloaded yet
2026-03-12 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/4.jpeg not downloaded yet
2026-03-12 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/5.jpeg not downloaded yet
2026-03-12 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/6.jpeg not downloaded yet
2026-03-12 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/7.jpeg not downloaded yet
2026-03-12 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/8.jpeg not downloaded yet
2026-03-12 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/9.jpeg not downloaded yet
2026-03-12 20:21:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:21:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122159)
2026-03-12 20:21:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66075e10>
2026-03-12 20:21:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/5.jpeg saved to cache
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98996b45-bccc-544f-9f7c-39304b16dd98
2026-03-12 20:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117801> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:21:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a2d1af7-30d7-5393-ba17-797df8afbe20 with identifier: 117801
2026-03-12 20:21:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a2d1af7-30d7-5393-ba17-797df8afbe20 with scrape type 1
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a2d1af7-30d7-5393-ba17-797df8afbe20
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/0.jpeg not downloaded yet
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/1.jpeg not downloaded yet
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/2.jpeg not downloaded yet
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/3.jpeg not downloaded yet
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/4.jpeg not downloaded yet
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/5.jpeg not downloaded yet
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/6.jpeg not downloaded yet
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/7.jpeg not downloaded yet
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/8.jpeg not downloaded yet
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/9.jpeg not downloaded yet
2026-03-12 20:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122159)
2026-03-12 20:21:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbec850>
2026-03-12 20:21:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/4.jpeg saved to cache
2026-03-12 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98996b45-bccc-544f-9f7c-39304b16dd98
2026-03-12 20:21:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123153> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:21:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd38e406-7616-5dbc-b23f-1c1cc4b918fa with identifier: 123153
2026-03-12 20:21:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa with scrape type 1
2026-03-12 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa
2026-03-12 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/0.jpeg not downloaded yet
2026-03-12 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/1.jpeg not downloaded yet
2026-03-12 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/2.jpeg not downloaded yet
2026-03-12 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/3.jpeg not downloaded yet
2026-03-12 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/4.jpeg not downloaded yet
2026-03-12 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/5.jpeg not downloaded yet
2026-03-12 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/6.jpeg not downloaded yet
2026-03-12 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/7.jpeg not downloaded yet
2026-03-12 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/8.jpeg not downloaded yet
2026-03-12 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/9.jpeg not downloaded yet
2026-03-12 20:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122159)
2026-03-12 20:21:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b7350>
2026-03-12 20:21:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/3.jpeg saved to cache
2026-03-12 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98996b45-bccc-544f-9f7c-39304b16dd98
2026-03-12 20:21:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122159)
2026-03-12 20:21:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778d7d0>
2026-03-12 20:21:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/2.jpeg saved to cache
2026-03-12 20:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98996b45-bccc-544f-9f7c-39304b16dd98
2026-03-12 20:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122159)
2026-03-12 20:21:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67629710>
2026-03-12 20:21:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/1.jpeg saved to cache
2026-03-12 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98996b45-bccc-544f-9f7c-39304b16dd98
2026-03-12 20:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122159)
2026-03-12 20:21:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718ced0>
2026-03-12 20:21:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/0.jpeg saved to cache
2026-03-12 20:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98996b45-bccc-544f-9f7c-39304b16dd98
2026-03-12 20:21:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98996b45-bccc-544f-9f7c-39304b16dd98, skipping ID generation
2026-03-12 20:21:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98996b45-bccc-544f-9f7c-39304b16dd98 with scrape type 1
2026-03-12 20:21:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98996b45-bccc-544f-9f7c-39304b16dd98 sending to next pipeline
2026-03-12 20:21:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 98996b45-bccc-544f-9f7c-39304b16dd98, identifier: 122159
2026-03-12 20:21:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 98996b45-bccc-544f-9f7c-39304b16dd98 with identifier: 122159
2026-03-12 20:21:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 98996b45-bccc-544f-9f7c-39304b16dd98 with identifier: 122159
2026-03-12 20:21:09 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 98996b45-bccc-544f-9f7c-39304b16dd98 with identifier: 122159 to the API
2026-03-12 20:21:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:21:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:21:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 67,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '98996b45-bccc-544f-9f7c-39304b16dd98',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BV22WFL',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/kia-picanto-hatchback-2020-10-x-line-s-5dr-auto-122159',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Kia',
'model': 'PICANTO HATCHBACK (2020)',
'odometer': 15036,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49639,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40323,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48953,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49802,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52326,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45854,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52495,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49941,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55222,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98996b45-bccc-544f-9f7c-39304b16dd98/98996b45-bccc-544f-9f7c-39304b16dd98_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38979,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122159/9.jpeg',
'Width': 800}],
'price': 13000.0,
'price_includes_vat': True,
'registration_date': '2022-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Kia PICANTO HATCHBACK (2020) 1.0 X-Line S 5dr Auto',
'transmission': 'automatic',
'trim': '1.0 X-Line S 5dr Auto',
'vin': 'KNAB3518YNT912814',
'year': 2022}
2026-03-12 20:21:09 [arval.uk] INFO: Saving data for 122159: {'created_time': 1773346869.519218, 'last_price_update_time': 1773346869.519227}
2026-03-12 20:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122960)
2026-03-12 20:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67644210>
2026-03-12 20:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/8.jpeg saved to cache
2026-03-12 20:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea
2026-03-12 20:21:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122960)
2026-03-12 20:21:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7af10>
2026-03-12 20:21:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/6.jpeg saved to cache
2026-03-12 20:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea
2026-03-12 20:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122960)
2026-03-12 20:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67120710>
2026-03-12 20:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/5.jpeg saved to cache
2026-03-12 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea
2026-03-12 20:21:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122960)
2026-03-12 20:21:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67647690>
2026-03-12 20:21:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/4.jpeg saved to cache
2026-03-12 20:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea
2026-03-12 20:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122960)
2026-03-12 20:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedb890>
2026-03-12 20:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/3.jpeg saved to cache
2026-03-12 20:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea
2026-03-12 20:21:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122960)
2026-03-12 20:21:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67644450>
2026-03-12 20:21:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/2.jpeg saved to cache
2026-03-12 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea
2026-03-12 20:21:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122960)
2026-03-12 20:21:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee2810>
2026-03-12 20:21:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/1.jpeg saved to cache
2026-03-12 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea
2026-03-12 20:21:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122960)
2026-03-12 20:21:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef0210>
2026-03-12 20:21:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/0.jpeg saved to cache
2026-03-12 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea
2026-03-12 20:21:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2784341e-ca4e-5867-bd7b-3d76e9fc0cea, skipping ID generation
2026-03-12 20:21:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea with scrape type 1
2026-03-12 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2784341e-ca4e-5867-bd7b-3d76e9fc0cea sending to next pipeline
2026-03-12 20:21:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 2784341e-ca4e-5867-bd7b-3d76e9fc0cea, identifier: 122960
2026-03-12 20:21:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 2784341e-ca4e-5867-bd7b-3d76e9fc0cea with identifier: 122960
2026-03-12 20:21:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 2784341e-ca4e-5867-bd7b-3d76e9fc0cea with identifier: 122960
2026-03-12 20:21:19 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 2784341e-ca4e-5867-bd7b-3d76e9fc0cea with identifier: 122960 to the API
2026-03-12 20:21:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:21:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:21:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 154,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '2784341e-ca4e-5867-bd7b-3d76e9fc0cea',
'is_damaged': False,
'is_operable': True,
'license_plate': 'FV72KKS',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-puma-hatchback-2019-10-ecoboost-hybrid-mhev-155-st-line-x-5dr-122960',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'PUMA HATCHBACK (2019)',
'odometer': 41751,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 59,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74308,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75833,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33726,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70903,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92130,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74335,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65195,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23560,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33794,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2784341e-ca4e-5867-bd7b-3d76e9fc0cea/2784341e-ca4e-5867-bd7b-3d76e9fc0cea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70537,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122960/9.jpeg',
'Width': 800}],
'price': 13100.0,
'price_includes_vat': True,
'registration_date': '2022-10-21',
'seats_number': 5,
'seller_name': None,
'title': 'Ford PUMA HATCHBACK (2019) 1.0 EcoBoost Hybrid mHEV 155 ST-Line X '
'5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost Hybrid mHEV 155 ST-Line X 5dr',
'vin': 'WF02XXERK2NJ23541',
'year': 2022}
2026-03-12 20:21:19 [arval.uk] INFO: Saving data for 122960: {'created_time': 1773346879.899304, 'last_price_update_time': 1773346879.899312}
2026-03-12 20:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123931)
2026-03-12 20:21:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbf4650>
2026-03-12 20:21:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/9.jpeg saved to cache
2026-03-12 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0
2026-03-12 20:21:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123931)
2026-03-12 20:21:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607b2d0>
2026-03-12 20:21:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/8.jpeg saved to cache
2026-03-12 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0
2026-03-12 20:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117801)
2026-03-12 20:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c147a90>
2026-03-12 20:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/9.jpeg saved to cache
2026-03-12 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a2d1af7-30d7-5393-ba17-797df8afbe20
2026-03-12 20:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117801)
2026-03-12 20:21:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718fbd0>
2026-03-12 20:21:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/8.jpeg saved to cache
2026-03-12 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a2d1af7-30d7-5393-ba17-797df8afbe20
2026-03-12 20:21:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123153)
2026-03-12 20:21:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67661a10>
2026-03-12 20:21:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/9.jpeg saved to cache
2026-03-12 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa
2026-03-12 20:21:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123153)
2026-03-12 20:21:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef12d0>
2026-03-12 20:21:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/8.jpeg saved to cache
2026-03-12 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa
2026-03-12 20:21:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123153)
2026-03-12 20:21:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c17b310>
2026-03-12 20:21:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/7.jpeg saved to cache
2026-03-12 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa
2026-03-12 20:21:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123153)
2026-03-12 20:21:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67120f50>
2026-03-12 20:21:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/6.jpeg saved to cache
2026-03-12 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa
2026-03-12 20:21:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123153)
2026-03-12 20:21:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778e150>
2026-03-12 20:21:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:21:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/5.jpeg saved to cache
2026-03-12 20:21:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa
2026-03-12 20:21:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123153)
2026-03-12 20:21:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67199210>
2026-03-12 20:21:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:21:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/4.jpeg saved to cache
2026-03-12 20:21:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa
2026-03-12 20:21:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123153)
2026-03-12 20:21:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b4ad0>
2026-03-12 20:21:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/3.jpeg saved to cache
2026-03-12 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa
2026-03-12 20:21:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123153)
2026-03-12 20:21:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763b350>
2026-03-12 20:21:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/2.jpeg saved to cache
2026-03-12 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa
2026-03-12 20:21:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123153)
2026-03-12 20:21:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef3310>
2026-03-12 20:21:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/1.jpeg saved to cache
2026-03-12 20:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa
2026-03-12 20:21:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123153)
2026-03-12 20:21:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67739e50>
2026-03-12 20:21:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/0.jpeg saved to cache
2026-03-12 20:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa
2026-03-12 20:21:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd38e406-7616-5dbc-b23f-1c1cc4b918fa, skipping ID generation
2026-03-12 20:21:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa with scrape type 1
2026-03-12 20:21:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd38e406-7616-5dbc-b23f-1c1cc4b918fa sending to next pipeline
2026-03-12 20:21:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: bd38e406-7616-5dbc-b23f-1c1cc4b918fa, identifier: 123153
2026-03-12 20:21:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: bd38e406-7616-5dbc-b23f-1c1cc4b918fa with identifier: 123153
2026-03-12 20:21:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: bd38e406-7616-5dbc-b23f-1c1cc4b918fa with identifier: 123153
2026-03-12 20:21:36 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: bd38e406-7616-5dbc-b23f-1c1cc4b918fa with identifier: 123153 to the API
2026-03-12 20:21:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:21:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:21:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 99,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'bd38e406-7616-5dbc-b23f-1c1cc4b918fa',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YR72RXV',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-fiesta-hatchback-2021-10-ecoboost-st-line-5dr-123153',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'FIESTA HATCHBACK (2021)',
'odometer': 19398,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41220,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43026,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43173,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38550,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50759,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41817,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41499,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39332,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121140,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd38e406-7616-5dbc-b23f-1c1cc4b918fa/bd38e406-7616-5dbc-b23f-1c1cc4b918fa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49478,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/123153/9.jpeg',
'Width': 800}],
'price': 12400.0,
'price_includes_vat': True,
'registration_date': '2022-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Ford FIESTA HATCHBACK (2021) 1.0 EcoBoost ST-Line 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost ST-Line 5dr',
'vin': 'WF0JXXGAHJNP53983',
'year': 2022}
2026-03-12 20:21:36 [arval.uk] INFO: Saving data for 123153: {'created_time': 1773346896.715071, 'last_price_update_time': 1773346896.715082}
2026-03-12 20:21:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117801)
2026-03-12 20:21:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:21:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5c5d0>
2026-03-12 20:21:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/7.jpeg saved to cache
2026-03-12 20:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a2d1af7-30d7-5393-ba17-797df8afbe20
2026-03-12 20:21:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117801)
2026-03-12 20:21:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbddf10>
2026-03-12 20:21:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:21:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/6.jpeg saved to cache
2026-03-12 20:21:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a2d1af7-30d7-5393-ba17-797df8afbe20
2026-03-12 20:21:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118732> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:21:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffd31b05-136f-5f12-b7b5-8868ccf50505 with identifier: 118732
2026-03-12 20:21:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd31b05-136f-5f12-b7b5-8868ccf50505 with scrape type 1
2026-03-12 20:21:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffd31b05-136f-5f12-b7b5-8868ccf50505
2026-03-12 20:21:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/0.jpeg not downloaded yet
2026-03-12 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/1.jpeg not downloaded yet
2026-03-12 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/2.jpeg not downloaded yet
2026-03-12 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/3.jpeg not downloaded yet
2026-03-12 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/4.jpeg not downloaded yet
2026-03-12 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/5.jpeg not downloaded yet
2026-03-12 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/6.jpeg not downloaded yet
2026-03-12 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/7.jpeg not downloaded yet
2026-03-12 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/8.jpeg not downloaded yet
2026-03-12 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/9.jpeg not downloaded yet
2026-03-12 20:21:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117801)
2026-03-12 20:21:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6773a750>
2026-03-12 20:21:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:21:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/5.jpeg saved to cache
2026-03-12 20:21:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a2d1af7-30d7-5393-ba17-797df8afbe20
2026-03-12 20:21:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117801)
2026-03-12 20:21:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb6090>
2026-03-12 20:21:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/4.jpeg saved to cache
2026-03-12 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a2d1af7-30d7-5393-ba17-797df8afbe20
2026-03-12 20:21:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117801)
2026-03-12 20:21:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5c790>
2026-03-12 20:21:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:21:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/3.jpeg saved to cache
2026-03-12 20:21:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a2d1af7-30d7-5393-ba17-797df8afbe20
2026-03-12 20:21:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117801)
2026-03-12 20:21:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6719bad0>
2026-03-12 20:21:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:21:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/2.jpeg saved to cache
2026-03-12 20:21:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a2d1af7-30d7-5393-ba17-797df8afbe20
2026-03-12 20:21:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117801)
2026-03-12 20:21:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5d290>
2026-03-12 20:21:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/1.jpeg saved to cache
2026-03-12 20:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a2d1af7-30d7-5393-ba17-797df8afbe20
2026-03-12 20:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/117801)
2026-03-12 20:21:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16dc90>
2026-03-12 20:21:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/0.jpeg saved to cache
2026-03-12 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a2d1af7-30d7-5393-ba17-797df8afbe20
2026-03-12 20:21:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a2d1af7-30d7-5393-ba17-797df8afbe20, skipping ID generation
2026-03-12 20:21:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a2d1af7-30d7-5393-ba17-797df8afbe20 with scrape type 1
2026-03-12 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a2d1af7-30d7-5393-ba17-797df8afbe20 sending to next pipeline
2026-03-12 20:21:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 8a2d1af7-30d7-5393-ba17-797df8afbe20, identifier: 117801
2026-03-12 20:21:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 8a2d1af7-30d7-5393-ba17-797df8afbe20 with identifier: 117801
2026-03-12 20:21:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 8a2d1af7-30d7-5393-ba17-797df8afbe20 with identifier: 117801
2026-03-12 20:21:46 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 8a2d1af7-30d7-5393-ba17-797df8afbe20 with identifier: 117801 to the API
2026-03-12 20:21:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:21:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:21:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 107,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '8a2d1af7-30d7-5393-ba17-797df8afbe20',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YH72VKV',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/seat-leon-hatchback-2020-10-tsi-evo-se-5dr-117801',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Seat',
'model': 'LEON HATCHBACK (2020)',
'odometer': 26002,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 54,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80472,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76216,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49809,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70822,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66771,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68774,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61522,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39442,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46009,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2d1af7-30d7-5393-ba17-797df8afbe20/8a2d1af7-30d7-5393-ba17-797df8afbe20_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50650,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/117801/9.jpeg',
'Width': 800}],
'price': 12700.0,
'price_includes_vat': True,
'registration_date': '2022-10-04',
'seats_number': 5,
'seller_name': None,
'title': 'Seat LEON HATCHBACK (2020) 1.0 TSI EVO SE 5dr',
'transmission': 'manual',
'trim': '1.0 TSI EVO SE 5dr',
'vin': 'VSSZZZKLZNR066211',
'year': 2022}
2026-03-12 20:21:46 [arval.uk] INFO: Saving data for 117801: {'created_time': 1773346906.916127, 'last_price_update_time': 1773346906.916137}
2026-03-12 20:21:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123931)
2026-03-12 20:21:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607a0d0>
2026-03-12 20:21:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/7.jpeg saved to cache
2026-03-12 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0
2026-03-12 20:21:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123931)
2026-03-12 20:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676473d0>
2026-03-12 20:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/6.jpeg saved to cache
2026-03-12 20:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0
2026-03-12 20:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123931)
2026-03-12 20:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f36310>
2026-03-12 20:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/5.jpeg saved to cache
2026-03-12 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0
2026-03-12 20:21:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123931)
2026-03-12 20:21:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778cd50>
2026-03-12 20:21:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/4.jpeg saved to cache
2026-03-12 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0
2026-03-12 20:21:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123931)
2026-03-12 20:21:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c179810>
2026-03-12 20:21:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:21:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/3.jpeg saved to cache
2026-03-12 20:21:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0
2026-03-12 20:21:51 [scrapy.extensions.logstats] INFO: Crawled 154 pages (at 4 pages/min), scraped 127 items (at 5 items/min)
2026-03-12 20:21:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123931)
2026-03-12 20:21:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f671236d0>
2026-03-12 20:21:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/2.jpeg saved to cache
2026-03-12 20:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0
2026-03-12 20:21:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123931)
2026-03-12 20:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660509d0>
2026-03-12 20:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/1.jpeg saved to cache
2026-03-12 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0
2026-03-12 20:21:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/123931)
2026-03-12 20:21:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607b710>
2026-03-12 20:21:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/0.jpeg saved to cache
2026-03-12 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0
2026-03-12 20:21:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1709ae9d-b60e-591a-a9e4-ec8087e084a0, skipping ID generation
2026-03-12 20:21:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0 with scrape type 1
2026-03-12 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1709ae9d-b60e-591a-a9e4-ec8087e084a0 sending to next pipeline
2026-03-12 20:21:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 1709ae9d-b60e-591a-a9e4-ec8087e084a0, identifier: 123931
2026-03-12 20:21:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 1709ae9d-b60e-591a-a9e4-ec8087e084a0 with identifier: 123931
2026-03-12 20:21:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 1709ae9d-b60e-591a-a9e4-ec8087e084a0 with identifier: 123931
2026-03-12 20:21:55 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 1709ae9d-b60e-591a-a9e4-ec8087e084a0 with identifier: 123931 to the API
2026-03-12 20:21:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:21:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:21:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 107,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '1709ae9d-b60e-591a-a9e4-ec8087e084a0',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YD72EBP',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/seat-leon-hatchback-2020-10-tsi-evo-se-dynamic-5dr-123931',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Seat',
'model': 'LEON HATCHBACK (2020)',
'odometer': 30776,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52662,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57223,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61362,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57621,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60524,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53327,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46185,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61910,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61568,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1709ae9d-b60e-591a-a9e4-ec8087e084a0/1709ae9d-b60e-591a-a9e4-ec8087e084a0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47563,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/123931/9.jpeg',
'Width': 1280}],
'price': 12900.0,
'price_includes_vat': True,
'registration_date': '2022-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Seat LEON HATCHBACK (2020) 1.0 TSI EVO SE Dynamic 5dr',
'transmission': 'manual',
'trim': '1.0 TSI EVO SE Dynamic 5dr',
'vin': 'VSSZZZKLZNR056358',
'year': 2022}
2026-03-12 20:21:55 [arval.uk] INFO: Saving data for 123931: {'created_time': 1773346915.770312, 'last_price_update_time': 1773346915.770322}
2026-03-12 20:21:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121766)
2026-03-12 20:21:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb61d0>
2026-03-12 20:21:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/7.jpeg saved to cache
2026-03-12 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208
2026-03-12 20:21:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121766)
2026-03-12 20:21:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660530d0>
2026-03-12 20:21:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/6.jpeg saved to cache
2026-03-12 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208
2026-03-12 20:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118732)
2026-03-12 20:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5d5d0>
2026-03-12 20:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:21:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:21:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/9.jpeg saved to cache
2026-03-12 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffd31b05-136f-5f12-b7b5-8868ccf50505
2026-03-12 20:22:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118732)
2026-03-12 20:22:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660505d0>
2026-03-12 20:22:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/8.jpeg saved to cache
2026-03-12 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffd31b05-136f-5f12-b7b5-8868ccf50505
2026-03-12 20:22:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118732)
2026-03-12 20:22:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0f92d0>
2026-03-12 20:22:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/7.jpeg saved to cache
2026-03-12 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffd31b05-136f-5f12-b7b5-8868ccf50505
2026-03-12 20:22:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118732)
2026-03-12 20:22:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cedba50>
2026-03-12 20:22:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/6.jpeg saved to cache
2026-03-12 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffd31b05-136f-5f12-b7b5-8868ccf50505
2026-03-12 20:22:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118732)
2026-03-12 20:22:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef1410>
2026-03-12 20:22:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/5.jpeg saved to cache
2026-03-12 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffd31b05-136f-5f12-b7b5-8868ccf50505
2026-03-12 20:22:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118732)
2026-03-12 20:22:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66051790>
2026-03-12 20:22:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/4.jpeg saved to cache
2026-03-12 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffd31b05-136f-5f12-b7b5-8868ccf50505
2026-03-12 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118732)
2026-03-12 20:22:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f7a750>
2026-03-12 20:22:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/3.jpeg saved to cache
2026-03-12 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffd31b05-136f-5f12-b7b5-8868ccf50505
2026-03-12 20:22:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118732)
2026-03-12 20:22:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67121d50>
2026-03-12 20:22:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/2.jpeg saved to cache
2026-03-12 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffd31b05-136f-5f12-b7b5-8868ccf50505
2026-03-12 20:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118732)
2026-03-12 20:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16c850>
2026-03-12 20:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/1.jpeg saved to cache
2026-03-12 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffd31b05-136f-5f12-b7b5-8868ccf50505
2026-03-12 20:22:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118732)
2026-03-12 20:22:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66053d90>
2026-03-12 20:22:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/0.jpeg saved to cache
2026-03-12 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffd31b05-136f-5f12-b7b5-8868ccf50505
2026-03-12 20:22:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffd31b05-136f-5f12-b7b5-8868ccf50505, skipping ID generation
2026-03-12 20:22:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd31b05-136f-5f12-b7b5-8868ccf50505 with scrape type 1
2026-03-12 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffd31b05-136f-5f12-b7b5-8868ccf50505 sending to next pipeline
2026-03-12 20:22:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: ffd31b05-136f-5f12-b7b5-8868ccf50505, identifier: 118732
2026-03-12 20:22:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: ffd31b05-136f-5f12-b7b5-8868ccf50505 with identifier: 118732
2026-03-12 20:22:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: ffd31b05-136f-5f12-b7b5-8868ccf50505 with identifier: 118732
2026-03-12 20:22:11 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: ffd31b05-136f-5f12-b7b5-8868ccf50505 with identifier: 118732 to the API
2026-03-12 20:22:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:22:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:22:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 99,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'ffd31b05-136f-5f12-b7b5-8868ccf50505',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YS72SBU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-fiesta-hatchback-2021-10-ecoboost-st-line-5dr-118732',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'FIESTA HATCHBACK (2021)',
'odometer': 16215,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 40,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91932,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97939,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94300,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73758,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63633,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92402,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91450,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80613,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 15313,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffd31b05-136f-5f12-b7b5-8868ccf50505/ffd31b05-136f-5f12-b7b5-8868ccf50505_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54172,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118732/9.jpeg',
'Width': 800}],
'price': 12400.0,
'price_includes_vat': True,
'registration_date': '2022-12-06',
'seats_number': 5,
'seller_name': None,
'title': 'Ford FIESTA HATCHBACK (2021) 1.0 EcoBoost ST-Line 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost ST-Line 5dr',
'vin': 'WF0JXXGAHJNB67675',
'year': 2022}
2026-03-12 20:22:11 [arval.uk] INFO: Saving data for 118732: {'created_time': 1773346931.811918, 'last_price_update_time': 1773346931.811928}
2026-03-12 20:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121766)
2026-03-12 20:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604da10>
2026-03-12 20:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/5.jpeg saved to cache
2026-03-12 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208
2026-03-12 20:22:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121766)
2026-03-12 20:22:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660521d0>
2026-03-12 20:22:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/4.jpeg saved to cache
2026-03-12 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208
2026-03-12 20:22:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121766)
2026-03-12 20:22:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbf40d0>
2026-03-12 20:22:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/3.jpeg saved to cache
2026-03-12 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208
2026-03-12 20:22:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121766)
2026-03-12 20:22:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604f810>
2026-03-12 20:22:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/2.jpeg saved to cache
2026-03-12 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208
2026-03-12 20:22:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121766)
2026-03-12 20:22:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66079710>
2026-03-12 20:22:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/1.jpeg saved to cache
2026-03-12 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208
2026-03-12 20:22:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121766)
2026-03-12 20:22:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778e490>
2026-03-12 20:22:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/0.jpeg saved to cache
2026-03-12 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208
2026-03-12 20:22:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208, skipping ID generation
2026-03-12 20:22:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208 with scrape type 1
2026-03-12 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208 sending to next pipeline
2026-03-12 20:22:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208, identifier: 121766
2026-03-12 20:22:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208 with identifier: 121766
2026-03-12 20:22:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208 with identifier: 121766
2026-03-12 20:22:18 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208 with identifier: 121766 to the API
2026-03-12 20:22:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:22:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:22:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 73,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DY72AOW',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/mazda-mazda2-hatchback-2019-15-skyactiv-g-75-se-l-5dr-121766',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Mazda',
'model': 'MAZDA2 HATCHBACK (2019)',
'odometer': 19769,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 38,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78372,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67270,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74558,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67347,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45336,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83169,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65974,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60561,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 16063,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208/0b2ce8d8-4bfb-55d3-8ae4-ad81f306a208_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37822,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121766/9.jpeg',
'Width': 800}],
'price': 11300.0,
'price_includes_vat': True,
'registration_date': '2022-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda MAZDA2 HATCHBACK (2019) 1.5 Skyactiv G 75 SE-L 5dr',
'transmission': 'manual',
'trim': '1.5 Skyactiv G 75 SE-L 5dr',
'vin': 'JMZDJ6HA601360987',
'year': 2022}
2026-03-12 20:22:18 [arval.uk] INFO: Saving data for 121766: {'created_time': 1773346938.939721, 'last_price_update_time': 1773346938.93973}
2026-03-12 20:22:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118910)
2026-03-12 20:22:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6719a5d0>
2026-03-12 20:22:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/8.jpeg saved to cache
2026-03-12 20:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a4c5d98-5198-5531-8efb-04b266a31189
2026-03-12 20:22:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118910)
2026-03-12 20:22:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f35d90>
2026-03-12 20:22:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/7.jpeg saved to cache
2026-03-12 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a4c5d98-5198-5531-8efb-04b266a31189
2026-03-12 20:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118910)
2026-03-12 20:22:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607b350>
2026-03-12 20:22:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/6.jpeg saved to cache
2026-03-12 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a4c5d98-5198-5531-8efb-04b266a31189
2026-03-12 20:22:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118910)
2026-03-12 20:22:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67639a50>
2026-03-12 20:22:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/5.jpeg saved to cache
2026-03-12 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a4c5d98-5198-5531-8efb-04b266a31189
2026-03-12 20:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118910)
2026-03-12 20:22:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a31d0>
2026-03-12 20:22:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/4.jpeg saved to cache
2026-03-12 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a4c5d98-5198-5531-8efb-04b266a31189
2026-03-12 20:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118910)
2026-03-12 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677398d0>
2026-03-12 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/3.jpeg saved to cache
2026-03-12 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a4c5d98-5198-5531-8efb-04b266a31189
2026-03-12 20:22:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118910)
2026-03-12 20:22:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cc0bb10>
2026-03-12 20:22:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/2.jpeg saved to cache
2026-03-12 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a4c5d98-5198-5531-8efb-04b266a31189
2026-03-12 20:22:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118910)
2026-03-12 20:22:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee2e50>
2026-03-12 20:22:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/1.jpeg saved to cache
2026-03-12 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a4c5d98-5198-5531-8efb-04b266a31189
2026-03-12 20:22:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/118910)
2026-03-12 20:22:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763b110>
2026-03-12 20:22:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/0.jpeg saved to cache
2026-03-12 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a4c5d98-5198-5531-8efb-04b266a31189
2026-03-12 20:22:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a4c5d98-5198-5531-8efb-04b266a31189, skipping ID generation
2026-03-12 20:22:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4c5d98-5198-5531-8efb-04b266a31189 with scrape type 1
2026-03-12 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a4c5d98-5198-5531-8efb-04b266a31189 sending to next pipeline
2026-03-12 20:22:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 7a4c5d98-5198-5531-8efb-04b266a31189, identifier: 118910
2026-03-12 20:22:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 7a4c5d98-5198-5531-8efb-04b266a31189 with identifier: 118910
2026-03-12 20:22:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 7a4c5d98-5198-5531-8efb-04b266a31189 with identifier: 118910
2026-03-12 20:22:30 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 7a4c5d98-5198-5531-8efb-04b266a31189 with identifier: 118910 to the API
2026-03-12 20:22:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:22:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:22:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 99,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '7a4c5d98-5198-5531-8efb-04b266a31189',
'is_damaged': False,
'is_operable': True,
'license_plate': 'FE72TZO',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/kia-picanto-hatchback-2020-10t-gdi-gt-line-s-5dr-4-seats-118910',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Kia',
'model': 'PICANTO HATCHBACK (2020)',
'odometer': 21594,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77187,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68118,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95646,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77591,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64510,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83339,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76116,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70311,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 16137,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4c5d98-5198-5531-8efb-04b266a31189/7a4c5d98-5198-5531-8efb-04b266a31189_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52554,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/118910/9.jpeg',
'Width': 800}],
'price': 12200.0,
'price_includes_vat': True,
'registration_date': '2022-10-26',
'seats_number': 4,
'seller_name': None,
'title': 'Kia PICANTO HATCHBACK (2020) 1.0T GDi GT-line S 5dr [4 seats]',
'transmission': 'manual',
'trim': '1.0T GDi GT-line S 5dr [4 seats]',
'vin': 'KNAB3519LPT000882',
'year': 2022}
2026-03-12 20:22:30 [arval.uk] INFO: Saving data for 118910: {'created_time': 1773346950.416231, 'last_price_update_time': 1773346950.416241}
2026-03-12 20:22:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116044)
2026-03-12 20:22:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67639750>
2026-03-12 20:22:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/7.jpeg saved to cache
2026-03-12 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de265a74-2122-5399-8d58-b44da9430d6e
2026-03-12 20:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116044)
2026-03-12 20:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718d310>
2026-03-12 20:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/6.jpeg saved to cache
2026-03-12 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de265a74-2122-5399-8d58-b44da9430d6e
2026-03-12 20:22:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116044)
2026-03-12 20:22:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef2290>
2026-03-12 20:22:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/5.jpeg saved to cache
2026-03-12 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de265a74-2122-5399-8d58-b44da9430d6e
2026-03-12 20:22:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116044)
2026-03-12 20:22:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718ef10>
2026-03-12 20:22:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/4.jpeg saved to cache
2026-03-12 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de265a74-2122-5399-8d58-b44da9430d6e
2026-03-12 20:22:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116044)
2026-03-12 20:22:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763b250>
2026-03-12 20:22:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/3.jpeg saved to cache
2026-03-12 20:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de265a74-2122-5399-8d58-b44da9430d6e
2026-03-12 20:22:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128153)
2026-03-12 20:22:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66077610>
2026-03-12 20:22:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:22:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/9.jpeg saved to cache
2026-03-12 20:22:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4
2026-03-12 20:22:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116044)
2026-03-12 20:22:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f35c10>
2026-03-12 20:22:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/2.jpeg saved to cache
2026-03-12 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de265a74-2122-5399-8d58-b44da9430d6e
2026-03-12 20:22:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128153)
2026-03-12 20:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66051cd0>
2026-03-12 20:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/8.jpeg saved to cache
2026-03-12 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4
2026-03-12 20:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116044)
2026-03-12 20:22:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f78e50>
2026-03-12 20:22:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/1.jpeg saved to cache
2026-03-12 20:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de265a74-2122-5399-8d58-b44da9430d6e
2026-03-12 20:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128153)
2026-03-12 20:22:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c179ad0>
2026-03-12 20:22:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/7.jpeg saved to cache
2026-03-12 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4
2026-03-12 20:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116044)
2026-03-12 20:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67629410>
2026-03-12 20:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/0.jpeg saved to cache
2026-03-12 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de265a74-2122-5399-8d58-b44da9430d6e
2026-03-12 20:22:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de265a74-2122-5399-8d58-b44da9430d6e, skipping ID generation
2026-03-12 20:22:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de265a74-2122-5399-8d58-b44da9430d6e with scrape type 1
2026-03-12 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de265a74-2122-5399-8d58-b44da9430d6e sending to next pipeline
2026-03-12 20:22:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: de265a74-2122-5399-8d58-b44da9430d6e, identifier: 116044
2026-03-12 20:22:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: de265a74-2122-5399-8d58-b44da9430d6e with identifier: 116044
2026-03-12 20:22:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: de265a74-2122-5399-8d58-b44da9430d6e with identifier: 116044
2026-03-12 20:22:43 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: de265a74-2122-5399-8d58-b44da9430d6e with identifier: 116044 to the API
2026-03-12 20:22:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:22:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:22:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 83,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'de265a74-2122-5399-8d58-b44da9430d6e',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BK72ZBR',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/hyundai-i10-hatchback-2020-12-mpi-se-connect-5dr-116044',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Hyundai',
'model': 'I10 HATCHBACK (2020)',
'odometer': 18392,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69598,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72209,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42975,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72465,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64928,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76978,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71308,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28889,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38387,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de265a74-2122-5399-8d58-b44da9430d6e/de265a74-2122-5399-8d58-b44da9430d6e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77076,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116044/9.jpeg',
'Width': 800}],
'price': 11300.0,
'price_includes_vat': True,
'registration_date': '2022-09-13',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai I10 HATCHBACK (2020) 1.2 MPi SE Connect 5dr',
'transmission': 'manual',
'trim': '1.2 MPi SE Connect 5dr',
'vin': 'NLHDN51ELNZ135592',
'year': 2022}
2026-03-12 20:22:43 [arval.uk] INFO: Saving data for 116044: {'created_time': 1773346963.427878, 'last_price_update_time': 1773346963.427887}
2026-03-12 20:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128153)
2026-03-12 20:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677cb750>
2026-03-12 20:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/6.jpeg saved to cache
2026-03-12 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4
2026-03-12 20:22:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128153)
2026-03-12 20:22:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607a010>
2026-03-12 20:22:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/5.jpeg saved to cache
2026-03-12 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4
2026-03-12 20:22:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128153)
2026-03-12 20:22:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c144050>
2026-03-12 20:22:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/4.jpeg saved to cache
2026-03-12 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4
2026-03-12 20:22:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128153)
2026-03-12 20:22:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb5c10>
2026-03-12 20:22:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/3.jpeg saved to cache
2026-03-12 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4
2026-03-12 20:22:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128153)
2026-03-12 20:22:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604fa10>
2026-03-12 20:22:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/2.jpeg saved to cache
2026-03-12 20:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4
2026-03-12 20:22:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128153)
2026-03-12 20:22:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66075ed0>
2026-03-12 20:22:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/1.jpeg saved to cache
2026-03-12 20:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4
2026-03-12 20:22:51 [scrapy.extensions.logstats] INFO: Crawled 154 pages (at 0 pages/min), scraped 132 items (at 5 items/min)
2026-03-12 20:22:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128153)
2026-03-12 20:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb5490>
2026-03-12 20:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/0.jpeg saved to cache
2026-03-12 20:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4
2026-03-12 20:22:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4, skipping ID generation
2026-03-12 20:22:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4 with scrape type 1
2026-03-12 20:22:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4 sending to next pipeline
2026-03-12 20:22:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4, identifier: 128153
2026-03-12 20:22:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4 with identifier: 128153
2026-03-12 20:22:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4 with identifier: 128153
2026-03-12 20:22:52 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 04588c3d-2b6c-52c3-a96d-b596ef6cf6a4 with identifier: 128153 to the API
2026-03-12 20:22:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:22:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:22:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 154,
'expiration_date': None,
'fuel_type': 'Electric',
'id': '04588c3d-2b6c-52c3-a96d-b596ef6cf6a4',
'is_damaged': False,
'is_operable': True,
'license_plate': 'WN72BJF',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/mg-mg5-electric-estate-2020-115kw-exclusive-ev-61kwh-5dr-auto-128153',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'MG',
'model': 'MG5 ELECTRIC ESTATE (2020)',
'odometer': 46950,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60666,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55347,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62154,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56885,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61492,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54232,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59164,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56042,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43611,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_04588c3d-2b6c-52c3-a96d-b596ef6cf6a4/04588c3d-2b6c-52c3-a96d-b596ef6cf6a4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47966,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128153/9.jpeg',
'Width': 800}],
'price': 10900.0,
'price_includes_vat': True,
'registration_date': '2022-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'MG MG5 ELECTRIC ESTATE (2020) 115kW Exclusive EV 61kWh 5dr Auto',
'transmission': 'automatic',
'trim': '115kW Exclusive EV 61kWh 5dr Auto',
'vin': 'LSJE24096NG071254',
'year': 2022}
2026-03-12 20:22:52 [arval.uk] INFO: Saving data for 128153: {'created_time': 1773346972.670933, 'last_price_update_time': 1773346972.670942}
2026-03-12 20:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/110459)
2026-03-12 20:22:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607afd0>
2026-03-12 20:22:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/7.jpeg saved to cache
2026-03-12 20:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff269da7-48c7-599d-9006-6437dfaa9ef5
2026-03-12 20:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119801)
2026-03-12 20:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66075950>
2026-03-12 20:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/9.jpeg saved to cache
2026-03-12 20:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1515c802-9134-5000-9d3d-3acfd88e0cb7
2026-03-12 20:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/110459)
2026-03-12 20:22:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f676633d0>
2026-03-12 20:22:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/6.jpeg saved to cache
2026-03-12 20:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff269da7-48c7-599d-9006-6437dfaa9ef5
2026-03-12 20:22:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119801)
2026-03-12 20:22:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6771b790>
2026-03-12 20:22:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/8.jpeg saved to cache
2026-03-12 20:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1515c802-9134-5000-9d3d-3acfd88e0cb7
2026-03-12 20:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/110459)
2026-03-12 20:22:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:22:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778f4d0>
2026-03-12 20:22:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:22:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:22:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:22:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/5.jpeg saved to cache
2026-03-12 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff269da7-48c7-599d-9006-6437dfaa9ef5
2026-03-12 20:23:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119801)
2026-03-12 20:23:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660749d0>
2026-03-12 20:23:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/7.jpeg saved to cache
2026-03-12 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1515c802-9134-5000-9d3d-3acfd88e0cb7
2026-03-12 20:23:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/110459)
2026-03-12 20:23:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67663c50>
2026-03-12 20:23:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/4.jpeg saved to cache
2026-03-12 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff269da7-48c7-599d-9006-6437dfaa9ef5
2026-03-12 20:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119801)
2026-03-12 20:23:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66075310>
2026-03-12 20:23:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/6.jpeg saved to cache
2026-03-12 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1515c802-9134-5000-9d3d-3acfd88e0cb7
2026-03-12 20:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/110459)
2026-03-12 20:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbef4d0>
2026-03-12 20:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/3.jpeg saved to cache
2026-03-12 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff269da7-48c7-599d-9006-6437dfaa9ef5
2026-03-12 20:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119801)
2026-03-12 20:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6718ea10>
2026-03-12 20:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/5.jpeg saved to cache
2026-03-12 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1515c802-9134-5000-9d3d-3acfd88e0cb7
2026-03-12 20:23:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/110459)
2026-03-12 20:23:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67662ed0>
2026-03-12 20:23:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/2.jpeg saved to cache
2026-03-12 20:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff269da7-48c7-599d-9006-6437dfaa9ef5
2026-03-12 20:23:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119801)
2026-03-12 20:23:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604dc90>
2026-03-12 20:23:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/4.jpeg saved to cache
2026-03-12 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1515c802-9134-5000-9d3d-3acfd88e0cb7
2026-03-12 20:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/110459)
2026-03-12 20:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c147b10>
2026-03-12 20:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/1.jpeg saved to cache
2026-03-12 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff269da7-48c7-599d-9006-6437dfaa9ef5
2026-03-12 20:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119801)
2026-03-12 20:23:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604dcd0>
2026-03-12 20:23:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/3.jpeg saved to cache
2026-03-12 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1515c802-9134-5000-9d3d-3acfd88e0cb7
2026-03-12 20:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/110459)
2026-03-12 20:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660ae210>
2026-03-12 20:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/0.jpeg saved to cache
2026-03-12 20:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff269da7-48c7-599d-9006-6437dfaa9ef5
2026-03-12 20:23:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff269da7-48c7-599d-9006-6437dfaa9ef5, skipping ID generation
2026-03-12 20:23:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff269da7-48c7-599d-9006-6437dfaa9ef5 with scrape type 1
2026-03-12 20:23:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff269da7-48c7-599d-9006-6437dfaa9ef5 sending to next pipeline
2026-03-12 20:23:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: ff269da7-48c7-599d-9006-6437dfaa9ef5, identifier: 110459
2026-03-12 20:23:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: ff269da7-48c7-599d-9006-6437dfaa9ef5 with identifier: 110459
2026-03-12 20:23:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: ff269da7-48c7-599d-9006-6437dfaa9ef5 with identifier: 110459
2026-03-12 20:23:11 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: ff269da7-48c7-599d-9006-6437dfaa9ef5 with identifier: 110459 to the API
2026-03-12 20:23:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:23:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:23:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 107,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'ff269da7-48c7-599d-9006-6437dfaa9ef5',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YF21XSC',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/seat-leon-hatchback-2020-10-tsi-evo-se-dynamic-5dr-110459',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Seat',
'model': 'LEON HATCHBACK (2020)',
'odometer': 30802,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87853,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78748,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83561,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66767,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83006,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81147,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86183,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75177,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139583,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff269da7-48c7-599d-9006-6437dfaa9ef5/ff269da7-48c7-599d-9006-6437dfaa9ef5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44156,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/110459/9.jpeg',
'Width': 1280}],
'price': 12100.0,
'price_includes_vat': True,
'registration_date': '2021-05-19',
'seats_number': 5,
'seller_name': None,
'title': 'Seat LEON HATCHBACK (2020) 1.0 TSI EVO SE Dynamic 5dr',
'transmission': 'manual',
'trim': '1.0 TSI EVO SE Dynamic 5dr',
'vin': 'VSSZZZKLZMR066149',
'year': 2021}
2026-03-12 20:23:11 [arval.uk] INFO: Saving data for 110459: {'created_time': 1773346991.458854, 'last_price_update_time': 1773346991.458864}
2026-03-12 20:23:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119801)
2026-03-12 20:23:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6712d290>
2026-03-12 20:23:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/2.jpeg saved to cache
2026-03-12 20:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1515c802-9134-5000-9d3d-3acfd88e0cb7
2026-03-12 20:23:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119801)
2026-03-12 20:23:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65fb2110>
2026-03-12 20:23:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:23:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/1.jpeg saved to cache
2026-03-12 20:23:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1515c802-9134-5000-9d3d-3acfd88e0cb7
2026-03-12 20:23:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/119801)
2026-03-12 20:23:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660afa10>
2026-03-12 20:23:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:23:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/0.jpeg saved to cache
2026-03-12 20:23:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1515c802-9134-5000-9d3d-3acfd88e0cb7
2026-03-12 20:23:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1515c802-9134-5000-9d3d-3acfd88e0cb7, skipping ID generation
2026-03-12 20:23:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1515c802-9134-5000-9d3d-3acfd88e0cb7 with scrape type 1
2026-03-12 20:23:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1515c802-9134-5000-9d3d-3acfd88e0cb7 sending to next pipeline
2026-03-12 20:23:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 1515c802-9134-5000-9d3d-3acfd88e0cb7, identifier: 119801
2026-03-12 20:23:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 1515c802-9134-5000-9d3d-3acfd88e0cb7 with identifier: 119801
2026-03-12 20:23:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 1515c802-9134-5000-9d3d-3acfd88e0cb7 with identifier: 119801
2026-03-12 20:23:15 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 1515c802-9134-5000-9d3d-3acfd88e0cb7 with identifier: 119801 to the API
2026-03-12 20:23:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:23:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:23:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 73,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '1515c802-9134-5000-9d3d-3acfd88e0cb7',
'is_damaged': False,
'is_operable': True,
'license_plate': 'MD22FTC',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/peugeot-208-hatchback-2019-12-puretech-active-premium-5dr-119801',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Peugeot',
'model': '208 HATCHBACK (2019)',
'odometer': 14022,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49649,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44600,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47220,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42345,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60976,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44760,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49603,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47455,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114169,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1515c802-9134-5000-9d3d-3acfd88e0cb7/1515c802-9134-5000-9d3d-3acfd88e0cb7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53176,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/119801/9.jpeg',
'Width': 800}],
'price': 11700.0,
'price_includes_vat': True,
'registration_date': '2022-07-26',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 HATCHBACK (2019) 1.2 PureTech Active Premium 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech Active Premium 5dr',
'vin': 'VR3UPHMHDNT061540',
'year': 2022}
2026-03-12 20:23:15 [arval.uk] INFO: Saving data for 119801: {'created_time': 1773346995.269691, 'last_price_update_time': 1773346995.2697}
2026-03-12 20:23:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128926)
2026-03-12 20:23:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c144150>
2026-03-12 20:23:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/6.jpeg saved to cache
2026-03-12 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2
2026-03-12 20:23:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128926)
2026-03-12 20:23:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660acb50>
2026-03-12 20:23:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/5.jpeg saved to cache
2026-03-12 20:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2
2026-03-12 20:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128926)
2026-03-12 20:23:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66080790>
2026-03-12 20:23:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/4.jpeg saved to cache
2026-03-12 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2
2026-03-12 20:23:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128926)
2026-03-12 20:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66051a10>
2026-03-12 20:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/3.jpeg saved to cache
2026-03-12 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2
2026-03-12 20:23:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128926)
2026-03-12 20:23:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c144410>
2026-03-12 20:23:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/2.jpeg saved to cache
2026-03-12 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2
2026-03-12 20:23:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128926)
2026-03-12 20:23:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660507d0>
2026-03-12 20:23:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/1.jpeg saved to cache
2026-03-12 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2
2026-03-12 20:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/128926)
2026-03-12 20:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66083550>
2026-03-12 20:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/0.jpeg saved to cache
2026-03-12 20:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2
2026-03-12 20:23:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0950cd13-0275-5a28-bcaf-bff3d8c8eba2, skipping ID generation
2026-03-12 20:23:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2 with scrape type 1
2026-03-12 20:23:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0950cd13-0275-5a28-bcaf-bff3d8c8eba2 sending to next pipeline
2026-03-12 20:23:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 0950cd13-0275-5a28-bcaf-bff3d8c8eba2, identifier: 128926
2026-03-12 20:23:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 0950cd13-0275-5a28-bcaf-bff3d8c8eba2 with identifier: 128926
2026-03-12 20:23:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 0950cd13-0275-5a28-bcaf-bff3d8c8eba2 with identifier: 128926
2026-03-12 20:23:23 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 0950cd13-0275-5a28-bcaf-bff3d8c8eba2 with identifier: 128926 to the API
2026-03-12 20:23:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:23:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:23:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '0950cd13-0275-5a28-bcaf-bff3d8c8eba2',
'is_damaged': False,
'is_operable': True,
'license_plate': 'VE74TZU',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/citroen-c3-hatchback-2020-12-puretech-plus-5dr-128926',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Citroen',
'model': 'C3 HATCHBACK (2020)',
'odometer': 10151,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89235,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85144,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101019,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76023,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89474,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97491,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93819,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91450,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70430,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0950cd13-0275-5a28-bcaf-bff3d8c8eba2/0950cd13-0275-5a28-bcaf-bff3d8c8eba2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62769,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/128926/9.jpeg',
'Width': 800}],
'price': 11900.0,
'price_includes_vat': True,
'registration_date': '2025-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 HATCHBACK (2020) 1.2 PureTech Plus 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech Plus 5dr',
'vin': 'VF7SXHMRVRT119792',
'year': 2025}
2026-03-12 20:23:25 [arval.uk] INFO: Saving data for 128926: {'created_time': 1773347005.566481, 'last_price_update_time': 1773347005.566491}
2026-03-12 20:23:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121493)
2026-03-12 20:23:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677baed0>
2026-03-12 20:23:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:23:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/6.jpeg saved to cache
2026-03-12 20:23:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2429a3a6-3d96-5981-82ab-340d0e726821
2026-03-12 20:23:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121493)
2026-03-12 20:23:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778fe90>
2026-03-12 20:23:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/5.jpeg saved to cache
2026-03-12 20:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2429a3a6-3d96-5981-82ab-340d0e726821
2026-03-12 20:23:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121493)
2026-03-12 20:23:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c17bdd0>
2026-03-12 20:23:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/4.jpeg saved to cache
2026-03-12 20:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2429a3a6-3d96-5981-82ab-340d0e726821
2026-03-12 20:23:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121493)
2026-03-12 20:23:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778dcd0>
2026-03-12 20:23:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:23:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/3.jpeg saved to cache
2026-03-12 20:23:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2429a3a6-3d96-5981-82ab-340d0e726821
2026-03-12 20:23:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121493)
2026-03-12 20:23:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c147750>
2026-03-12 20:23:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/2.jpeg saved to cache
2026-03-12 20:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2429a3a6-3d96-5981-82ab-340d0e726821
2026-03-12 20:23:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121493)
2026-03-12 20:23:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604e550>
2026-03-12 20:23:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/1.jpeg saved to cache
2026-03-12 20:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2429a3a6-3d96-5981-82ab-340d0e726821
2026-03-12 20:23:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/121493)
2026-03-12 20:23:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762acd0>
2026-03-12 20:23:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:23:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/0.jpeg saved to cache
2026-03-12 20:23:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2429a3a6-3d96-5981-82ab-340d0e726821
2026-03-12 20:23:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2429a3a6-3d96-5981-82ab-340d0e726821, skipping ID generation
2026-03-12 20:23:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2429a3a6-3d96-5981-82ab-340d0e726821 with scrape type 1
2026-03-12 20:23:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2429a3a6-3d96-5981-82ab-340d0e726821 sending to next pipeline
2026-03-12 20:23:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 2429a3a6-3d96-5981-82ab-340d0e726821, identifier: 121493
2026-03-12 20:23:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 2429a3a6-3d96-5981-82ab-340d0e726821 with identifier: 121493
2026-03-12 20:23:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 2429a3a6-3d96-5981-82ab-340d0e726821 with identifier: 121493
2026-03-12 20:23:33 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 2429a3a6-3d96-5981-82ab-340d0e726821 with identifier: 121493 to the API
2026-03-12 20:23:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:23:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:23:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 107,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '2429a3a6-3d96-5981-82ab-340d0e726821',
'is_damaged': False,
'is_operable': True,
'license_plate': 'WN72XWY',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/seat-ibiza-hatchback-2021-10-tsi-110-fr-5dr-121493',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Seat',
'model': 'IBIZA HATCHBACK (2021)',
'odometer': 44047,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83938,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82840,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99887,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74649,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94993,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97178,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72828,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58202,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85330,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2429a3a6-3d96-5981-82ab-340d0e726821/2429a3a6-3d96-5981-82ab-340d0e726821_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86643,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/121493/9.jpeg',
'Width': 800}],
'price': 11600.0,
'price_includes_vat': True,
'registration_date': '2022-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Seat IBIZA HATCHBACK (2021) 1.0 TSI 110 FR 5dr',
'transmission': 'manual',
'trim': '1.0 TSI 110 FR 5dr',
'vin': 'VSSZZZKJZNR127612',
'year': 2022}
2026-03-12 20:23:34 [arval.uk] INFO: Saving data for 121493: {'created_time': 1773347014.93679, 'last_price_update_time': 1773347014.936802}
2026-03-12 20:23:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127504)
2026-03-12 20:23:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f36550>
2026-03-12 20:23:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/7.jpeg saved to cache
2026-03-12 20:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda
2026-03-12 20:23:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127504)
2026-03-12 20:23:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778e390>
2026-03-12 20:23:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/6.jpeg saved to cache
2026-03-12 20:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda
2026-03-12 20:23:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127504)
2026-03-12 20:23:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef0650>
2026-03-12 20:23:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/5.jpeg saved to cache
2026-03-12 20:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda
2026-03-12 20:23:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127504)
2026-03-12 20:23:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6719af50>
2026-03-12 20:23:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:23:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/4.jpeg saved to cache
2026-03-12 20:23:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda
2026-03-12 20:23:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127504)
2026-03-12 20:23:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67660850>
2026-03-12 20:23:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:23:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/3.jpeg saved to cache
2026-03-12 20:23:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda
2026-03-12 20:23:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127504)
2026-03-12 20:23:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778df90>
2026-03-12 20:23:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:23:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/2.jpeg saved to cache
2026-03-12 20:23:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda
2026-03-12 20:23:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127504)
2026-03-12 20:23:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762b110>
2026-03-12 20:23:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/1.jpeg saved to cache
2026-03-12 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda
2026-03-12 20:23:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127504)
2026-03-12 20:23:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66052610>
2026-03-12 20:23:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:23:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/0.jpeg saved to cache
2026-03-12 20:23:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda
2026-03-12 20:23:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f0a1100-b36b-5a3e-b855-7eff7ee22eda, skipping ID generation
2026-03-12 20:23:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda with scrape type 1
2026-03-12 20:23:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f0a1100-b36b-5a3e-b855-7eff7ee22eda sending to next pipeline
2026-03-12 20:23:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 6f0a1100-b36b-5a3e-b855-7eff7ee22eda, identifier: 127504
2026-03-12 20:23:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 6f0a1100-b36b-5a3e-b855-7eff7ee22eda with identifier: 127504
2026-03-12 20:23:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 6f0a1100-b36b-5a3e-b855-7eff7ee22eda with identifier: 127504
2026-03-12 20:23:44 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 6f0a1100-b36b-5a3e-b855-7eff7ee22eda with identifier: 127504 to the API
2026-03-12 20:23:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:23:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:23:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 122,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '6f0a1100-b36b-5a3e-b855-7eff7ee22eda',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YO22BFF',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-puma-hatchback-2019-10-ecoboost-hybrid-mhev-st-line-5dr-127504',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'PUMA HATCHBACK (2019)',
'odometer': 69424,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88415,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88945,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83253,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76301,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98258,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75607,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93877,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87689,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62996,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f0a1100-b36b-5a3e-b855-7eff7ee22eda/6f0a1100-b36b-5a3e-b855-7eff7ee22eda_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94177,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127504/9.jpeg',
'Width': 800}],
'price': 11300.0,
'price_includes_vat': True,
'registration_date': '2022-08-21',
'seats_number': 5,
'seller_name': None,
'title': 'Ford PUMA HATCHBACK (2019) 1.0 EcoBoost Hybrid mHEV ST-Line 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost Hybrid mHEV ST-Line 5dr',
'vin': 'WF02XXERK2NM58575',
'year': 2022}
2026-03-12 20:23:45 [arval.uk] INFO: Saving data for 127504: {'created_time': 1773347025.674812, 'last_price_update_time': 1773347025.674821}
2026-03-12 20:23:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122094)
2026-03-12 20:23:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb7fd0>
2026-03-12 20:23:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/7.jpeg saved to cache
2026-03-12 20:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f6226e1-c486-59ae-a78d-600ffe82593d
2026-03-12 20:23:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122094)
2026-03-12 20:23:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66051650>
2026-03-12 20:23:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/6.jpeg saved to cache
2026-03-12 20:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f6226e1-c486-59ae-a78d-600ffe82593d
2026-03-12 20:23:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122094)
2026-03-12 20:23:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f47d50>
2026-03-12 20:23:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/5.jpeg saved to cache
2026-03-12 20:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f6226e1-c486-59ae-a78d-600ffe82593d
2026-03-12 20:23:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122094)
2026-03-12 20:23:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604c450>
2026-03-12 20:23:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/4.jpeg saved to cache
2026-03-12 20:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f6226e1-c486-59ae-a78d-600ffe82593d
2026-03-12 20:23:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122094)
2026-03-12 20:23:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6607bfd0>
2026-03-12 20:23:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:23:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/3.jpeg saved to cache
2026-03-12 20:23:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f6226e1-c486-59ae-a78d-600ffe82593d
2026-03-12 20:23:51 [scrapy.extensions.logstats] INFO: Crawled 154 pages (at 0 pages/min), scraped 138 items (at 6 items/min)
2026-03-12 20:23:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:23:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122094)
2026-03-12 20:23:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66052c90>
2026-03-12 20:23:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:23:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/2.jpeg saved to cache
2026-03-12 20:23:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f6226e1-c486-59ae-a78d-600ffe82593d
2026-03-12 20:23:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122094)
2026-03-12 20:23:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762b290>
2026-03-12 20:23:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:23:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/1.jpeg saved to cache
2026-03-12 20:23:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f6226e1-c486-59ae-a78d-600ffe82593d
2026-03-12 20:23:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/122094)
2026-03-12 20:23:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778f3d0>
2026-03-12 20:23:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/0.jpeg saved to cache
2026-03-12 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f6226e1-c486-59ae-a78d-600ffe82593d
2026-03-12 20:23:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f6226e1-c486-59ae-a78d-600ffe82593d, skipping ID generation
2026-03-12 20:23:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f6226e1-c486-59ae-a78d-600ffe82593d with scrape type 1
2026-03-12 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f6226e1-c486-59ae-a78d-600ffe82593d sending to next pipeline
2026-03-12 20:23:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 5f6226e1-c486-59ae-a78d-600ffe82593d, identifier: 122094
2026-03-12 20:23:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 5f6226e1-c486-59ae-a78d-600ffe82593d with identifier: 122094
2026-03-12 20:23:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 5f6226e1-c486-59ae-a78d-600ffe82593d with identifier: 122094
2026-03-12 20:23:55 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 5f6226e1-c486-59ae-a78d-600ffe82593d with identifier: 122094 to the API
2026-03-12 20:23:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:23:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:23:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 91,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '5f6226e1-c486-59ae-a78d-600ffe82593d',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DV72YVK',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/nissan-micra-hatchback-2016-10-ig-t-92-tekna-5dr-122094',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Nissan',
'model': 'MICRA HATCHBACK (2016)',
'odometer': 26539,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 40,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70578,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76896,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96417,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73273,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69854,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85646,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85339,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73013,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 16445,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f6226e1-c486-59ae-a78d-600ffe82593d/5f6226e1-c486-59ae-a78d-600ffe82593d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71844,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/122094/9.jpeg',
'Width': 800}],
'price': 11000.0,
'price_includes_vat': True,
'registration_date': '2022-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan MICRA HATCHBACK (2016) 1.0 IG-T 92 Tekna 5dr',
'transmission': 'manual',
'trim': '1.0 IG-T 92 Tekna 5dr',
'vin': 'VNVK1400469921732',
'year': 2022}
2026-03-12 20:23:55 [arval.uk] INFO: Saving data for 122094: {'created_time': 1773347035.476755, 'last_price_update_time': 1773347035.476766}
2026-03-12 20:23:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116045)
2026-03-12 20:23:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee2f90>
2026-03-12 20:23:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:23:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/4.jpeg saved to cache
2026-03-12 20:23:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a81de434-b548-50c8-bdf7-d1c0d8e0932f
2026-03-12 20:23:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116045)
2026-03-12 20:23:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6ced9950>
2026-03-12 20:23:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:23:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/3.jpeg saved to cache
2026-03-12 20:23:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a81de434-b548-50c8-bdf7-d1c0d8e0932f
2026-03-12 20:23:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116045)
2026-03-12 20:23:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762a490>
2026-03-12 20:23:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:23:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/2.jpeg saved to cache
2026-03-12 20:23:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a81de434-b548-50c8-bdf7-d1c0d8e0932f
2026-03-12 20:23:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116045)
2026-03-12 20:23:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:23:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee3890>
2026-03-12 20:23:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:23:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:23:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:23:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:23:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/1.jpeg saved to cache
2026-03-12 20:23:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a81de434-b548-50c8-bdf7-d1c0d8e0932f
2026-03-12 20:24:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/116045)
2026-03-12 20:24:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6604ec50>
2026-03-12 20:24:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:24:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/0.jpeg saved to cache
2026-03-12 20:24:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a81de434-b548-50c8-bdf7-d1c0d8e0932f
2026-03-12 20:24:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a81de434-b548-50c8-bdf7-d1c0d8e0932f, skipping ID generation
2026-03-12 20:24:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a81de434-b548-50c8-bdf7-d1c0d8e0932f with scrape type 1
2026-03-12 20:24:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a81de434-b548-50c8-bdf7-d1c0d8e0932f sending to next pipeline
2026-03-12 20:24:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: a81de434-b548-50c8-bdf7-d1c0d8e0932f, identifier: 116045
2026-03-12 20:24:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: a81de434-b548-50c8-bdf7-d1c0d8e0932f with identifier: 116045
2026-03-12 20:24:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: a81de434-b548-50c8-bdf7-d1c0d8e0932f with identifier: 116045
2026-03-12 20:24:01 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: a81de434-b548-50c8-bdf7-d1c0d8e0932f with identifier: 116045 to the API
2026-03-12 20:24:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:24:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:24:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 91,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'a81de434-b548-50c8-bdf7-d1c0d8e0932f',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DY72ATV',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/nissan-micra-hatchback-2016-10-ig-t-92-tekna-5dr-116045',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Nissan',
'model': 'MICRA HATCHBACK (2016)',
'odometer': 28044,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71968,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65689,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37613,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74953,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65893,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80689,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64040,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37874,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81830,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a81de434-b548-50c8-bdf7-d1c0d8e0932f/a81de434-b548-50c8-bdf7-d1c0d8e0932f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67619,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/116045/9.jpeg',
'Width': 800}],
'price': 10900.0,
'price_includes_vat': True,
'registration_date': '2022-09-05',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan MICRA HATCHBACK (2016) 1.0 IG-T 92 Tekna 5dr',
'transmission': 'manual',
'trim': '1.0 IG-T 92 Tekna 5dr',
'vin': 'VNVK1400469673742',
'year': 2022}
2026-03-12 20:24:01 [arval.uk] INFO: Saving data for 116045: {'created_time': 1773347041.53174, 'last_price_update_time': 1773347041.531749}
2026-03-12 20:24:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114780)
2026-03-12 20:24:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67764910>
2026-03-12 20:24:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/9.jpeg saved to cache
2026-03-12 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75be1a3b-cf84-5e07-82ce-bb7199261017
2026-03-12 20:24:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114780)
2026-03-12 20:24:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67123810>
2026-03-12 20:24:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:24:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/7.jpeg saved to cache
2026-03-12 20:24:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75be1a3b-cf84-5e07-82ce-bb7199261017
2026-03-12 20:24:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114780)
2026-03-12 20:24:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67198150>
2026-03-12 20:24:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:24:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/6.jpeg saved to cache
2026-03-12 20:24:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75be1a3b-cf84-5e07-82ce-bb7199261017
2026-03-12 20:24:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114780)
2026-03-12 20:24:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66079690>
2026-03-12 20:24:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:24:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/4.jpeg saved to cache
2026-03-12 20:24:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75be1a3b-cf84-5e07-82ce-bb7199261017
2026-03-12 20:24:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114780)
2026-03-12 20:24:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6763ae50>
2026-03-12 20:24:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/3.jpeg saved to cache
2026-03-12 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75be1a3b-cf84-5e07-82ce-bb7199261017
2026-03-12 20:24:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114780)
2026-03-12 20:24:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66082290>
2026-03-12 20:24:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/2.jpeg saved to cache
2026-03-12 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75be1a3b-cf84-5e07-82ce-bb7199261017
2026-03-12 20:24:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114780)
2026-03-12 20:24:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67120350>
2026-03-12 20:24:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:24:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/1.jpeg saved to cache
2026-03-12 20:24:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75be1a3b-cf84-5e07-82ce-bb7199261017
2026-03-12 20:24:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/114780)
2026-03-12 20:24:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66083e90>
2026-03-12 20:24:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:24:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/0.jpeg saved to cache
2026-03-12 20:24:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75be1a3b-cf84-5e07-82ce-bb7199261017
2026-03-12 20:24:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75be1a3b-cf84-5e07-82ce-bb7199261017, skipping ID generation
2026-03-12 20:24:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75be1a3b-cf84-5e07-82ce-bb7199261017 with scrape type 1
2026-03-12 20:24:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75be1a3b-cf84-5e07-82ce-bb7199261017 sending to next pipeline
2026-03-12 20:24:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 75be1a3b-cf84-5e07-82ce-bb7199261017, identifier: 114780
2026-03-12 20:24:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 75be1a3b-cf84-5e07-82ce-bb7199261017 with identifier: 114780
2026-03-12 20:24:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 75be1a3b-cf84-5e07-82ce-bb7199261017 with identifier: 114780
2026-03-12 20:24:11 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 75be1a3b-cf84-5e07-82ce-bb7199261017 with identifier: 114780 to the API
2026-03-12 20:24:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:24:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:24:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '75be1a3b-cf84-5e07-82ce-bb7199261017',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DU72LDE',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ds-ds-3-crossback-hatchback-2019-12-puretech-montmartre-5dr-114780',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'DS',
'model': 'DS 3 CROSSBACK HATCHBACK (2019)',
'odometer': 27615,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49810,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58469,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49973,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41286,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50315,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45647,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49677,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39862,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83511,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75be1a3b-cf84-5e07-82ce-bb7199261017/75be1a3b-cf84-5e07-82ce-bb7199261017_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55672,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/114780/9.jpeg',
'Width': 800}],
'price': 10800.0,
'price_includes_vat': True,
'registration_date': '2023-01-16',
'seats_number': 5,
'seller_name': None,
'title': 'DS DS 3 CROSSBACK HATCHBACK (2019) 1.2 PureTech Montmartre 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech Montmartre 5dr',
'vin': 'VR1URHNEKNW109694',
'year': 2023}
2026-03-12 20:24:12 [arval.uk] INFO: Saving data for 114780: {'created_time': 1773347052.221821, 'last_price_update_time': 1773347052.221831}
2026-03-12 20:24:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124612)
2026-03-12 20:24:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6762b2d0>
2026-03-12 20:24:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:24:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/8.jpeg saved to cache
2026-03-12 20:24:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4
2026-03-12 20:24:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124612)
2026-03-12 20:24:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778e750>
2026-03-12 20:24:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:24:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/7.jpeg saved to cache
2026-03-12 20:24:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4
2026-03-12 20:24:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124612)
2026-03-12 20:24:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cef3a50>
2026-03-12 20:24:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/6.jpeg saved to cache
2026-03-12 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4
2026-03-12 20:24:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124612)
2026-03-12 20:24:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778e3d0>
2026-03-12 20:24:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/5.jpeg saved to cache
2026-03-12 20:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4
2026-03-12 20:24:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124612)
2026-03-12 20:24:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6ced9b90>
2026-03-12 20:24:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/4.jpeg saved to cache
2026-03-12 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4
2026-03-12 20:24:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124612)
2026-03-12 20:24:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66081850>
2026-03-12 20:24:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/3.jpeg saved to cache
2026-03-12 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4
2026-03-12 20:24:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124612)
2026-03-12 20:24:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67121c50>
2026-03-12 20:24:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/2.jpeg saved to cache
2026-03-12 20:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4
2026-03-12 20:24:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124612)
2026-03-12 20:24:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677eb7d0>
2026-03-12 20:24:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/1.jpeg saved to cache
2026-03-12 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4
2026-03-12 20:24:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/124612)
2026-03-12 20:24:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:24:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67122150>
2026-03-12 20:24:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/0.jpeg saved to cache
2026-03-12 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4
2026-03-12 20:24:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63b57e2e-a6cb-5e45-be77-34d5575e17c4, skipping ID generation
2026-03-12 20:24:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4 with scrape type 1
2026-03-12 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63b57e2e-a6cb-5e45-be77-34d5575e17c4 sending to next pipeline
2026-03-12 20:24:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 63b57e2e-a6cb-5e45-be77-34d5575e17c4, identifier: 124612
2026-03-12 20:24:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 63b57e2e-a6cb-5e45-be77-34d5575e17c4 with identifier: 124612
2026-03-12 20:24:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 63b57e2e-a6cb-5e45-be77-34d5575e17c4 with identifier: 124612
2026-03-12 20:24:22 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 63b57e2e-a6cb-5e45-be77-34d5575e17c4 with identifier: 124612 to the API
2026-03-12 20:24:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:24:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:24:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 91,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '63b57e2e-a6cb-5e45-be77-34d5575e17c4',
'is_damaged': False,
'is_operable': True,
'license_plate': 'DS72KKP',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/nissan-micra-hatchback-2016-10-ig-t-92-acenta-5dr-vision-pack-124612',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Nissan',
'model': 'MICRA HATCHBACK (2016)',
'odometer': 22848,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46032,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48326,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46084,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39678,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44031,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43218,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46315,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40371,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60413,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_63b57e2e-a6cb-5e45-be77-34d5575e17c4/63b57e2e-a6cb-5e45-be77-34d5575e17c4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63323,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/124612/9.jpeg',
'Width': 800}],
'price': 10800.0,
'price_includes_vat': True,
'registration_date': '2022-12-08',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan MICRA HATCHBACK (2016) 1.0 IG-T 92 Acenta 5dr [Vision Pack]',
'transmission': 'manual',
'trim': '1.0 IG-T 92 Acenta 5dr [Vision Pack]',
'vin': 'VNVK1400769931591',
'year': 2022}
2026-03-12 20:24:24 [arval.uk] INFO: Saving data for 124612: {'created_time': 1773347064.666659, 'last_price_update_time': 1773347064.666668}
2026-03-12 20:24:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127908)
2026-03-12 20:24:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:24:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677eb8d0>
2026-03-12 20:24:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/5.jpeg saved to cache
2026-03-12 20:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd
2026-03-12 20:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127908)
2026-03-12 20:24:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67122a90>
2026-03-12 20:24:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/4.jpeg saved to cache
2026-03-12 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd
2026-03-12 20:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126844> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:24:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a83aa535-6c4f-5ea0-860c-ca28118482a6 with identifier: 126844
2026-03-12 20:24:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a83aa535-6c4f-5ea0-860c-ca28118482a6 with scrape type 1
2026-03-12 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a83aa535-6c4f-5ea0-860c-ca28118482a6
2026-03-12 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/0.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/1.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/2.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/3.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/4.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/5.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/6.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/7.jpeg not downloaded yet
2026-03-12 20:24:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/8.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/9.jpeg not downloaded yet
2026-03-12 20:24:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113197> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:24:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dec3d86e-9092-5ad6-9358-0552bff16fc7 with identifier: 113197
2026-03-12 20:24:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dec3d86e-9092-5ad6-9358-0552bff16fc7 with scrape type 1
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dec3d86e-9092-5ad6-9358-0552bff16fc7
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/0.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/1.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/2.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/3.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/4.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/5.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/6.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/7.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/8.jpeg not downloaded yet
2026-03-12 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/9.jpeg not downloaded yet
2026-03-12 20:24:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127908)
2026-03-12 20:24:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677c8cd0>
2026-03-12 20:24:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/3.jpeg saved to cache
2026-03-12 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd
2026-03-12 20:24:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-12 20:24:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127908)
2026-03-12 20:24:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67647e10>
2026-03-12 20:24:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/2.jpeg saved to cache
2026-03-12 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd
2026-03-12 20:24:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113847> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:24:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127908)
2026-03-12 20:24:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0 with identifier: 113847
2026-03-12 20:24:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0 with scrape type 1
2026-03-12 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0
2026-03-12 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/0.jpeg not downloaded yet
2026-03-12 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/1.jpeg not downloaded yet
2026-03-12 20:24:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f671225d0>
2026-03-12 20:24:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/1.jpeg saved to cache
2026-03-12 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd
2026-03-12 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/2.jpeg not downloaded yet
2026-03-12 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/3.jpeg not downloaded yet
2026-03-12 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/4.jpeg not downloaded yet
2026-03-12 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/5.jpeg not downloaded yet
2026-03-12 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/6.jpeg not downloaded yet
2026-03-12 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/7.jpeg not downloaded yet
2026-03-12 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/8.jpeg not downloaded yet
2026-03-12 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/9.jpeg not downloaded yet
2026-03-12 20:24:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/127908)
2026-03-12 20:24:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67628050>
2026-03-12 20:24:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:24:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/0.jpeg saved to cache
2026-03-12 20:24:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd
2026-03-12 20:24:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd, skipping ID generation
2026-03-12 20:24:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd with scrape type 1
2026-03-12 20:24:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd sending to next pipeline
2026-03-12 20:24:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd, identifier: 127908
2026-03-12 20:24:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd with identifier: 127908
2026-03-12 20:24:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd with identifier: 127908
2026-03-12 20:24:30 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd with identifier: 127908 to the API
2026-03-12 20:24:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:24:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:24:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 135,
'expiration_date': None,
'fuel_type': 'Electric',
'id': 'f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd',
'is_damaged': False,
'is_operable': True,
'license_plate': 'FG72ZDR',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/citroen-e-c4-electric-hatchback-2020-100kw-sense-50kwh-5dr-auto-11kwch-127908',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Citroen',
'model': 'E-C4 ELECTRIC HATCHBACK (2020)',
'odometer': 46857,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54598,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47706,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53377,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52340,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53200,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40389,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53703,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53593,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37350,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd/f494bb66-7b6e-5bc4-8b4d-d3fbe5bb69bd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84154,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/127908/9.jpeg',
'Width': 800}],
'price': 10300.0,
'price_includes_vat': True,
'registration_date': '2022-12-11',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen E-C4 ELECTRIC HATCHBACK (2020) 100kW Sense 50kWh 5dr Auto '
'[11kWCh]',
'transmission': 'automatic',
'trim': '100kW Sense 50kWh 5dr Auto [11kWCh]',
'vin': 'VR7BCZKXCNE055951',
'year': 2022}
2026-03-12 20:24:31 [arval.uk] INFO: Saving data for 127908: {'created_time': 1773347071.431995, 'last_price_update_time': 1773347071.432005}
2026-03-12 20:24:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115424)
2026-03-12 20:24:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778d390>
2026-03-12 20:24:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/8.jpeg saved to cache
2026-03-12 20:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3cd838b-8975-5122-82c7-6fa736e5da53
2026-03-12 20:24:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115424)
2026-03-12 20:24:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5d090>
2026-03-12 20:24:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/7.jpeg saved to cache
2026-03-12 20:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3cd838b-8975-5122-82c7-6fa736e5da53
2026-03-12 20:24:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115424)
2026-03-12 20:24:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677398d0>
2026-03-12 20:24:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/6.jpeg saved to cache
2026-03-12 20:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3cd838b-8975-5122-82c7-6fa736e5da53
2026-03-12 20:24:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115424)
2026-03-12 20:24:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5cc90>
2026-03-12 20:24:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/5.jpeg saved to cache
2026-03-12 20:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3cd838b-8975-5122-82c7-6fa736e5da53
2026-03-12 20:24:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115424)
2026-03-12 20:24:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f44050>
2026-03-12 20:24:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/4.jpeg saved to cache
2026-03-12 20:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3cd838b-8975-5122-82c7-6fa736e5da53
2026-03-12 20:24:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115424)
2026-03-12 20:24:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66076350>
2026-03-12 20:24:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:24:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/3.jpeg saved to cache
2026-03-12 20:24:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3cd838b-8975-5122-82c7-6fa736e5da53
2026-03-12 20:24:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115424)
2026-03-12 20:24:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677eae50>
2026-03-12 20:24:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:24:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/2.jpeg saved to cache
2026-03-12 20:24:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3cd838b-8975-5122-82c7-6fa736e5da53
2026-03-12 20:24:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115424)
2026-03-12 20:24:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a4e10>
2026-03-12 20:24:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/1.jpeg saved to cache
2026-03-12 20:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3cd838b-8975-5122-82c7-6fa736e5da53
2026-03-12 20:24:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/115424)
2026-03-12 20:24:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778f6d0>
2026-03-12 20:24:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:24:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/0.jpeg saved to cache
2026-03-12 20:24:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3cd838b-8975-5122-82c7-6fa736e5da53
2026-03-12 20:24:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3cd838b-8975-5122-82c7-6fa736e5da53, skipping ID generation
2026-03-12 20:24:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3cd838b-8975-5122-82c7-6fa736e5da53 with scrape type 1
2026-03-12 20:24:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3cd838b-8975-5122-82c7-6fa736e5da53 sending to next pipeline
2026-03-12 20:24:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: c3cd838b-8975-5122-82c7-6fa736e5da53, identifier: 115424
2026-03-12 20:24:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: c3cd838b-8975-5122-82c7-6fa736e5da53 with identifier: 115424
2026-03-12 20:24:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: c3cd838b-8975-5122-82c7-6fa736e5da53 with identifier: 115424
2026-03-12 20:24:42 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: c3cd838b-8975-5122-82c7-6fa736e5da53 with identifier: 115424 to the API
2026-03-12 20:24:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:24:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:24:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'c3cd838b-8975-5122-82c7-6fa736e5da53',
'is_damaged': False,
'is_operable': True,
'license_plate': 'MD21HRG',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/citroen-c3-hatchback-2020-12-puretech-shine-5dr-115424',
'listing': 'directbuy',
'location': 'UK Manheim',
'make': 'Citroen',
'model': 'C3 HATCHBACK (2020)',
'odometer': 27052,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67576,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/0.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60667,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/1.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58492,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/2.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49438,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/3.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55742,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/4.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142326,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/5.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74919,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/6.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89107,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/7.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96407,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/8.jpeg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3cd838b-8975-5122-82c7-6fa736e5da53/c3cd838b-8975-5122-82c7-6fa736e5da53_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96324,
'Height': 720,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/721/115424/9.jpeg',
'Width': 1280}],
'price': 9000.0,
'price_includes_vat': True,
'registration_date': '2021-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 HATCHBACK (2020) 1.2 PureTech Shine 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech Shine 5dr',
'vin': 'VF7SXHMRVMT592302',
'year': 2021}
2026-03-12 20:24:42 [arval.uk] INFO: Saving data for 115424: {'created_time': 1773347082.433309, 'last_price_update_time': 1773347082.43332}
2026-03-12 20:24:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126844)
2026-03-12 20:24:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0aee90>
2026-03-12 20:24:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:24:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/9.jpeg saved to cache
2026-03-12 20:24:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a83aa535-6c4f-5ea0-860c-ca28118482a6
2026-03-12 20:24:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113197)
2026-03-12 20:24:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67719890>
2026-03-12 20:24:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:24:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/9.jpeg saved to cache
2026-03-12 20:24:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dec3d86e-9092-5ad6-9358-0552bff16fc7
2026-03-12 20:24:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113197)
2026-03-12 20:24:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677eb790>
2026-03-12 20:24:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:24:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/8.jpeg saved to cache
2026-03-12 20:24:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dec3d86e-9092-5ad6-9358-0552bff16fc7
2026-03-12 20:24:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113197)
2026-03-12 20:24:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66051c90>
2026-03-12 20:24:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/7.jpeg saved to cache
2026-03-12 20:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dec3d86e-9092-5ad6-9358-0552bff16fc7
2026-03-12 20:24:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125688> (referer: https://autoselect.arval.co.uk) ['zyte-api']
2026-03-12 20:24:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88127cfc-a88e-512d-809e-c3524ab9eeb4 with identifier: 125688
2026-03-12 20:24:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88127cfc-a88e-512d-809e-c3524ab9eeb4 with scrape type 1
2026-03-12 20:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 88127cfc-a88e-512d-809e-c3524ab9eeb4
2026-03-12 20:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/0.jpeg not downloaded yet
2026-03-12 20:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/1.jpeg not downloaded yet
2026-03-12 20:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/2.jpeg not downloaded yet
2026-03-12 20:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/3.jpeg not downloaded yet
2026-03-12 20:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/4.jpeg not downloaded yet
2026-03-12 20:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/5.jpeg not downloaded yet
2026-03-12 20:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/6.jpeg not downloaded yet
2026-03-12 20:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/7.jpeg not downloaded yet
2026-03-12 20:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/8.jpeg not downloaded yet
2026-03-12 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/9.jpeg not downloaded yet
2026-03-12 20:24:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113197)
2026-03-12 20:24:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f47410>
2026-03-12 20:24:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/6.jpeg saved to cache
2026-03-12 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dec3d86e-9092-5ad6-9358-0552bff16fc7
2026-03-12 20:24:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113847)
2026-03-12 20:24:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a5fd0>
2026-03-12 20:24:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:24:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/9.jpeg saved to cache
2026-03-12 20:24:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0
2026-03-12 20:24:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113847)
2026-03-12 20:24:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66074810>
2026-03-12 20:24:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:24:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/8.jpeg saved to cache
2026-03-12 20:24:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0
2026-03-12 20:24:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113847)
2026-03-12 20:24:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660a6f50>
2026-03-12 20:24:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:24:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/7.jpeg saved to cache
2026-03-12 20:24:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0
2026-03-12 20:24:51 [scrapy.extensions.logstats] INFO: Crawled 158 pages (at 4 pages/min), scraped 144 items (at 6 items/min)
2026-03-12 20:24:51 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-12 20:24:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113847)
2026-03-12 20:24:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c181ad0>
2026-03-12 20:24:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:24:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/6.jpeg saved to cache
2026-03-12 20:24:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0
2026-03-12 20:24:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113847)
2026-03-12 20:24:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677197d0>
2026-03-12 20:24:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/5.jpeg saved to cache
2026-03-12 20:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0
2026-03-12 20:24:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113847)
2026-03-12 20:24:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5eb10>
2026-03-12 20:24:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:24:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/4.jpeg saved to cache
2026-03-12 20:24:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0
2026-03-12 20:24:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113847)
2026-03-12 20:24:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f44ed0>
2026-03-12 20:24:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/3.jpeg saved to cache
2026-03-12 20:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0
2026-03-12 20:24:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113847)
2026-03-12 20:24:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67611a10>
2026-03-12 20:24:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/2.jpeg saved to cache
2026-03-12 20:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0
2026-03-12 20:24:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113847)
2026-03-12 20:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67647410>
2026-03-12 20:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/1.jpeg saved to cache
2026-03-12 20:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0
2026-03-12 20:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113847)
2026-03-12 20:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c2e9050>
2026-03-12 20:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:24:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:24:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/0.jpeg saved to cache
2026-03-12 20:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0
2026-03-12 20:24:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0, skipping ID generation
2026-03-12 20:24:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0 with scrape type 1
2026-03-12 20:24:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0 sending to next pipeline
2026-03-12 20:24:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0, identifier: 113847
2026-03-12 20:24:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0 with identifier: 113847
2026-03-12 20:24:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0 with identifier: 113847
2026-03-12 20:24:59 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0 with identifier: 113847 to the API
2026-03-12 20:24:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:25:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:25:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 99,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YR72URG',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-fiesta-hatchback-2021-10-ecoboost-st-line-5dr-113847',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'FIESTA HATCHBACK (2021)',
'odometer': 19120,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76161,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72720,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71692,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67571,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74080,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62370,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78322,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78103,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81654,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0/cb1d3fdd-e02f-5630-8ec4-ddd7d283bdb0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97834,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113847/9.jpeg',
'Width': 800}],
'price': 12200.0,
'price_includes_vat': True,
'registration_date': '2022-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford FIESTA HATCHBACK (2021) 1.0 EcoBoost ST-Line 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost ST-Line 5dr',
'vin': 'WF0JXXGAHJNP53715',
'year': 2022}
2026-03-12 20:25:00 [arval.uk] INFO: Saving data for 113847: {'created_time': 1773347100.336675, 'last_price_update_time': 1773347100.336685}
2026-03-12 20:25:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113197)
2026-03-12 20:25:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a1b50>
2026-03-12 20:25:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:25:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/5.jpeg saved to cache
2026-03-12 20:25:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dec3d86e-9092-5ad6-9358-0552bff16fc7
2026-03-12 20:25:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113197)
2026-03-12 20:25:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbe4250>
2026-03-12 20:25:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:25:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/4.jpeg saved to cache
2026-03-12 20:25:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dec3d86e-9092-5ad6-9358-0552bff16fc7
2026-03-12 20:25:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113197)
2026-03-12 20:25:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66074810>
2026-03-12 20:25:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:25:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/3.jpeg saved to cache
2026-03-12 20:25:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dec3d86e-9092-5ad6-9358-0552bff16fc7
2026-03-12 20:25:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113197)
2026-03-12 20:25:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67613310>
2026-03-12 20:25:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/2.jpeg saved to cache
2026-03-12 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dec3d86e-9092-5ad6-9358-0552bff16fc7
2026-03-12 20:25:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113197)
2026-03-12 20:25:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c0dc110>
2026-03-12 20:25:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:25:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/1.jpeg saved to cache
2026-03-12 20:25:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dec3d86e-9092-5ad6-9358-0552bff16fc7
2026-03-12 20:25:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/9.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125688)
2026-03-12 20:25:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67612090>
2026-03-12 20:25:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_9.jpg HTTP/1.1" 201 0
2026-03-12 20:25:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/9.jpeg saved to cache
2026-03-12 20:25:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 88127cfc-a88e-512d-809e-c3524ab9eeb4
2026-03-12 20:25:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125688)
2026-03-12 20:25:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbeec10>
2026-03-12 20:25:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:25:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/8.jpeg saved to cache
2026-03-12 20:25:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 88127cfc-a88e-512d-809e-c3524ab9eeb4
2026-03-12 20:25:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125688)
2026-03-12 20:25:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5d090>
2026-03-12 20:25:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:25:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/7.jpeg saved to cache
2026-03-12 20:25:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88127cfc-a88e-512d-809e-c3524ab9eeb4
2026-03-12 20:25:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125688)
2026-03-12 20:25:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b8650>
2026-03-12 20:25:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:25:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/6.jpeg saved to cache
2026-03-12 20:25:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88127cfc-a88e-512d-809e-c3524ab9eeb4
2026-03-12 20:25:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125688)
2026-03-12 20:25:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f67660650>
2026-03-12 20:25:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/5.jpeg saved to cache
2026-03-12 20:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88127cfc-a88e-512d-809e-c3524ab9eeb4
2026-03-12 20:25:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125688)
2026-03-12 20:25:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16e4d0>
2026-03-12 20:25:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/4.jpeg saved to cache
2026-03-12 20:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88127cfc-a88e-512d-809e-c3524ab9eeb4
2026-03-12 20:25:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125688)
2026-03-12 20:25:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660766d0>
2026-03-12 20:25:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:25:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/3.jpeg saved to cache
2026-03-12 20:25:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88127cfc-a88e-512d-809e-c3524ab9eeb4
2026-03-12 20:25:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125688)
2026-03-12 20:25:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6c16d250>
2026-03-12 20:25:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/2.jpeg saved to cache
2026-03-12 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88127cfc-a88e-512d-809e-c3524ab9eeb4
2026-03-12 20:25:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125688)
2026-03-12 20:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f5d0d0>
2026-03-12 20:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/1.jpeg saved to cache
2026-03-12 20:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88127cfc-a88e-512d-809e-c3524ab9eeb4
2026-03-12 20:25:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/125688)
2026-03-12 20:25:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660b8d50>
2026-03-12 20:25:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/0.jpeg saved to cache
2026-03-12 20:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88127cfc-a88e-512d-809e-c3524ab9eeb4
2026-03-12 20:25:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88127cfc-a88e-512d-809e-c3524ab9eeb4, skipping ID generation
2026-03-12 20:25:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88127cfc-a88e-512d-809e-c3524ab9eeb4 with scrape type 1
2026-03-12 20:25:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88127cfc-a88e-512d-809e-c3524ab9eeb4 sending to next pipeline
2026-03-12 20:25:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: 88127cfc-a88e-512d-809e-c3524ab9eeb4, identifier: 125688
2026-03-12 20:25:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: 88127cfc-a88e-512d-809e-c3524ab9eeb4 with identifier: 125688
2026-03-12 20:25:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: 88127cfc-a88e-512d-809e-c3524ab9eeb4 with identifier: 125688
2026-03-12 20:25:17 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: 88127cfc-a88e-512d-809e-c3524ab9eeb4 with identifier: 125688 to the API
2026-03-12 20:25:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:25:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:25:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 111,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '88127cfc-a88e-512d-809e-c3524ab9eeb4',
'is_damaged': False,
'is_operable': True,
'license_plate': 'FV72UKL',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/nissan-juke-hatchback-2019-10-dig-t-114-n-connecta-5dr-125688',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Nissan',
'model': 'JUKE HATCHBACK (2019)',
'odometer': 22513,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44286,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49032,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39491,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46219,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46241,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44674,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43491,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41675,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43121,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_88127cfc-a88e-512d-809e-c3524ab9eeb4/88127cfc-a88e-512d-809e-c3524ab9eeb4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49163,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/125688/9.jpeg',
'Width': 800}],
'price': 12200.0,
'price_includes_vat': True,
'registration_date': '2022-11-22',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan JUKE HATCHBACK (2019) 1.0 DiG-T 114 N-Connecta 5dr',
'transmission': 'manual',
'trim': '1.0 DiG-T 114 N-Connecta 5dr',
'vin': 'SJNFAAF16U1203491',
'year': 2022}
2026-03-12 20:25:18 [arval.uk] INFO: Saving data for 125688: {'created_time': 1773347118.170908, 'last_price_update_time': 1773347118.170917}
2026-03-12 20:25:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/113197)
2026-03-12 20:25:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cbb6690>
2026-03-12 20:25:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:25:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/0.jpeg saved to cache
2026-03-12 20:25:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dec3d86e-9092-5ad6-9358-0552bff16fc7
2026-03-12 20:25:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dec3d86e-9092-5ad6-9358-0552bff16fc7, skipping ID generation
2026-03-12 20:25:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dec3d86e-9092-5ad6-9358-0552bff16fc7 with scrape type 1
2026-03-12 20:25:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dec3d86e-9092-5ad6-9358-0552bff16fc7 sending to next pipeline
2026-03-12 20:25:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: dec3d86e-9092-5ad6-9358-0552bff16fc7, identifier: 113197
2026-03-12 20:25:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: dec3d86e-9092-5ad6-9358-0552bff16fc7 with identifier: 113197
2026-03-12 20:25:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: dec3d86e-9092-5ad6-9358-0552bff16fc7 with identifier: 113197
2026-03-12 20:25:18 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: dec3d86e-9092-5ad6-9358-0552bff16fc7 with identifier: 113197 to the API
2026-03-12 20:25:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:25:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:25:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 111,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'dec3d86e-9092-5ad6-9358-0552bff16fc7',
'is_damaged': False,
'is_operable': True,
'license_plate': 'BN72XTF',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/nissan-juke-hatchback-2019-10-dig-t-114-tekna-5dr-113197',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Nissan',
'model': 'JUKE HATCHBACK (2019)',
'odometer': 32076,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84255,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69926,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85292,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82419,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79516,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74213,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90664,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78081,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84426,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dec3d86e-9092-5ad6-9358-0552bff16fc7/dec3d86e-9092-5ad6-9358-0552bff16fc7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94432,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/113197/9.jpeg',
'Width': 800}],
'price': 12300.0,
'price_includes_vat': True,
'registration_date': '2022-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan JUKE HATCHBACK (2019) 1.0 DiG-T 114 Tekna 5dr',
'transmission': 'manual',
'trim': '1.0 DiG-T 114 Tekna 5dr',
'vin': 'SJNFAAF16U1187728',
'year': 2022}
2026-03-12 20:25:19 [arval.uk] INFO: Saving data for 113197: {'created_time': 1773347119.018163, 'last_price_update_time': 1773347119.018172}
2026-03-12 20:25:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/8.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126844)
2026-03-12 20:25:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f660777d0>
2026-03-12 20:25:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_8.jpg HTTP/1.1" 201 0
2026-03-12 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/8.jpeg saved to cache
2026-03-12 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a83aa535-6c4f-5ea0-860c-ca28118482a6
2026-03-12 20:25:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/7.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126844)
2026-03-12 20:25:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a3810>
2026-03-12 20:25:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_7.jpg HTTP/1.1" 201 0
2026-03-12 20:25:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/7.jpeg saved to cache
2026-03-12 20:25:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a83aa535-6c4f-5ea0-860c-ca28118482a6
2026-03-12 20:25:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/6.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126844)
2026-03-12 20:25:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f47c50>
2026-03-12 20:25:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_6.jpg HTTP/1.1" 201 0
2026-03-12 20:25:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/6.jpeg saved to cache
2026-03-12 20:25:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a83aa535-6c4f-5ea0-860c-ca28118482a6
2026-03-12 20:25:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/5.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126844)
2026-03-12 20:25:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6cee1b10>
2026-03-12 20:25:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_5.jpg HTTP/1.1" 201 0
2026-03-12 20:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/5.jpeg saved to cache
2026-03-12 20:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a83aa535-6c4f-5ea0-860c-ca28118482a6
2026-03-12 20:25:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/4.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126844)
2026-03-12 20:25:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f478d0>
2026-03-12 20:25:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_4.jpg HTTP/1.1" 201 0
2026-03-12 20:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/4.jpeg saved to cache
2026-03-12 20:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a83aa535-6c4f-5ea0-860c-ca28118482a6
2026-03-12 20:25:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/3.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126844)
2026-03-12 20:25:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f66076fd0>
2026-03-12 20:25:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_3.jpg HTTP/1.1" 201 0
2026-03-12 20:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/3.jpeg saved to cache
2026-03-12 20:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a83aa535-6c4f-5ea0-860c-ca28118482a6
2026-03-12 20:25:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/2.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126844)
2026-03-12 20:25:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f6778fe50>
2026-03-12 20:25:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_2.jpg HTTP/1.1" 201 0
2026-03-12 20:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/2.jpeg saved to cache
2026-03-12 20:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a83aa535-6c4f-5ea0-860c-ca28118482a6
2026-03-12 20:25:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/1.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126844)
2026-03-12 20:25:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f677a34d0>
2026-03-12 20:25:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_1.jpg HTTP/1.1" 201 0
2026-03-12 20:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/1.jpeg saved to cache
2026-03-12 20:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a83aa535-6c4f-5ea0-860c-ca28118482a6
2026-03-12 20:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/0.jpeg> (referer: https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/3/126844)
2026-03-12 20:25:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-12 20:25:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7f65f44750>
2026-03-12 20:25:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-12 20:25:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-12 20:25:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-12 20:25:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_0.jpg HTTP/1.1" 201 0
2026-03-12 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/0.jpeg saved to cache
2026-03-12 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a83aa535-6c4f-5ea0-860c-ca28118482a6
2026-03-12 20:25:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a83aa535-6c4f-5ea0-860c-ca28118482a6, skipping ID generation
2026-03-12 20:25:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a83aa535-6c4f-5ea0-860c-ca28118482a6 with scrape type 1
2026-03-12 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a83aa535-6c4f-5ea0-860c-ca28118482a6 sending to next pipeline
2026-03-12 20:25:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: arval.uk, Processed item id: a83aa535-6c4f-5ea0-860c-ca28118482a6, identifier: 126844
2026-03-12 20:25:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.uk, Translating item: a83aa535-6c4f-5ea0-860c-ca28118482a6 with identifier: 126844
2026-03-12 20:25:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.uk, Applying rules to item: a83aa535-6c4f-5ea0-860c-ca28118482a6 with identifier: 126844
2026-03-12 20:25:30 [crawlers.pipelines.post_to_api] INFO: Spider: arval.uk, Posting item: a83aa535-6c4f-5ea0-860c-ca28118482a6 with identifier: 126844 to the API
2026-03-12 20:25:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-03-12 20:25:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-12 20:25:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/0.jpeg>
{'auction_title': '',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 99,
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'a83aa535-6c4f-5ea0-860c-ca28118482a6',
'is_damaged': False,
'is_operable': True,
'license_plate': 'YP72UOT',
'link_to_web_offer': 'https://autoselect.arval.co.uk/used-cars/deal/ford-fiesta-hatchback-2021-10-ecoboost-st-line-5dr-126844',
'listing': 'directbuy',
'location': 'UK Carbase',
'make': 'Ford',
'model': 'FIESTA HATCHBACK (2021)',
'odometer': 26511,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46621,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/0.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46570,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/1.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48027,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/2.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39486,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/3.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45350,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/4.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41944,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/5.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46671,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/6.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41617,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/7.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47067,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/8.jpeg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a83aa535-6c4f-5ea0-860c-ca28118482a6/a83aa535-6c4f-5ea0-860c-ca28118482a6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32727,
'Height': 600,
'OriginUrl': 'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/3/93/126844/9.jpeg',
'Width': 800}],
'price': 12300.0,
'price_includes_vat': True,
'registration_date': '2023-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'Ford FIESTA HATCHBACK (2021) 1.0 EcoBoost ST-Line 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost ST-Line 5dr',
'vin': 'WF0JXXGAHJNB67396',
'year': 2023}
2026-03-12 20:25:31 [arval.uk] INFO: Saving data for 126844: {'created_time': 1773347131.699217, 'last_price_update_time': 1773347131.699226}
2026-03-12 20:25:31 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-12 20:25:31 [arval.uk] INFO: arval.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-12 20:25:32 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (148 items) in: file:///var/lib/scrapyd/items/sourcing_v2/arval.uk/2026-03-12T19_54_44.jl
2026-03-12 20:25:32 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 906147,
'downloader/request_count': 1638,
'downloader/request_method_count/GET': 1638,
'downloader/response_bytes': 104759524,
'downloader/response_count': 1638,
'downloader/response_status_count/200': 1638,
'elapsed_time_seconds': 1840.161367,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 12, 20, 25, 31, 908476, tzinfo=datetime.timezone.utc),
'item_scraped_count': 148,
'log_count/DEBUG': 5407,
'log_count/INFO': 12256,
'memusage/max': 170209280,
'memusage/startup': 148258816,
'photo_download_count': 1480,
'playwright/context_count': 1,
'playwright/context_count/max_concurrent': 1,
'playwright/context_count/persistent/False': 1,
'playwright/context_count/remote/False': 1,
'playwright/page_count': 1,
'playwright/page_count/max_concurrent': 1,
'playwright/request_count': 27,
'playwright/request_count/aborted': 10,
'playwright/request_count/method/GET': 26,
'playwright/request_count/method/POST': 1,
'playwright/request_count/navigation': 2,
'playwright/request_count/resource_type/document': 2,
'playwright/request_count/resource_type/font': 5,
'playwright/request_count/resource_type/image': 8,
'playwright/request_count/resource_type/script': 7,
'playwright/request_count/resource_type/stylesheet': 1,
'playwright/request_count/resource_type/xhr': 4,
'playwright/response_count': 13,
'playwright/response_count/method/GET': 13,
'playwright/response_count/resource_type/document': 2,
'playwright/response_count/resource_type/font': 5,
'playwright/response_count/resource_type/script': 5,
'playwright/response_count/resource_type/stylesheet': 1,
'request_depth_max': 10,
'response_received_count': 158,
'scheduler/dequeued': 1638,
'scheduler/dequeued/memory': 1638,
'scheduler/enqueued': 1638,
'scheduler/enqueued/memory': 1638,
'scrape_type/new': 148,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 157,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 2.5667744243078556,
'scrapy-zyte-api/mean_response_seconds': 2.581007200868647,
'scrapy-zyte-api/processed': 157,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 157,
'scrapy-zyte-api/request_args/experimental.requestCookies': 156,
'scrapy-zyte-api/request_args/experimental.responseCookies': 157,
'scrapy-zyte-api/request_args/httpResponseBody': 157,
'scrapy-zyte-api/request_args/httpResponseHeaders': 157,
'scrapy-zyte-api/request_args/sessionContext': 157,
'scrapy-zyte-api/request_args/url': 157,
'scrapy-zyte-api/status_codes/200': 157,
'scrapy-zyte-api/success': 157,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 12, 19, 54, 51, 747109, tzinfo=datetime.timezone.utc)}
2026-03-12 20:25:32 [scrapy.core.engine] INFO: Spider closed (finished)