2026-04-22 13:10:46 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-04-22 13:10:46 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-04-22 13:10:46 [manheim.gb] INFO: Starting spider manheim.gb
2026-04-22 13:10:46 [scrapy.addons] INFO: Enabled addons:
[]
2026-04-22 13:10:46 [asyncio] DEBUG: Using selector: EpollSelector
2026-04-22 13:10:46 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-04-22 13:10:46 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-04-22 13:10:46 [scrapy.extensions.telnet] INFO: Telnet Password: 913abd40632aabc5
2026-04-22 13:10:46 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-04-22 13:10:46 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/manheim.gb/2026-04-22T13_10_41.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-04-22 13:10:46 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-04-22 13:10:46 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-04-22 13:10:46 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-04-22 13:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-04-22 13:10:46 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-04-22 13:10:46 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-04-22 13:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-04-22 13:10:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2099
2026-04-22 13:10:46 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-04-22 13:10:46 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-04-22 13:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-04-22 13:10:46 [common.geocoding.geonames_geocoder] WARNING: GeoNames data directory not found: /usr/src/app/common/geocoding/data. Geocoding will not be available. Run download_geonames.py first.
2026-04-22 13:10:46 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:10:46 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.geocoding_pipeline.GeocodingPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-04-22 13:10:46 [scrapy.core.engine] INFO: Spider opened
2026-04-22 13:10:46 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-04-22 13:10:46 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-04-22 13:10:46 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-04-22 13:10:46 [scrapy-playwright] INFO: Starting download handler
2026-04-22 13:10:46 [scrapy-playwright] INFO: Starting download handler
2026-04-22 13:10:51 [scrapy-playwright] INFO: Launching browser firefox
2026-04-22 13:10:52 [scrapy-playwright] INFO: Browser firefox launched
2026-04-22 13:10:52 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-04-22 13:10:53 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-04-22 13:10:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2026-04-22 13:10:53 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://www.manheim.co.uk/>
2026-04-22 13:10:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/>
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=DY4qznOW3bgt96gBNI_XqLhl2kfUNbW47Xh8LDm7O4A1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=LseUIn9GrPAbkGiexoPp7rAvZhUh2ezC8RYYqlsrYww1> (resource type: script, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=DY4qznOW3bgt96gBNI_XqLhl2kfUNbW47Xh8LDm7O4A1>
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=DY4qznOW3bgt96gBNI_XqLhl2kfUNbW47Xh8LDm7O4A1)
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=DY4qznOW3bgt96gBNI_XqLhl2kfUNbW47Xh8LDm7O4A1)
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=LseUIn9GrPAbkGiexoPp7rAvZhUh2ezC8RYYqlsrYww1>
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2026-04-22 13:10:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/enter_sim.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/enter_sim.ashx?la=en&mw=1920>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/sytner1.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/sytner1.ashx?la=en&mw=1920>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.313.1.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.313.1.min.js>
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.313.1.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.313.1.min.js>
2026-04-22 13:10:57 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2026-04-22 13:10:57 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20UK&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2026-04-22 13:10:58 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20UK&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2026-04-22 13:10:58 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=959740332&visitor_id_sign=7cf25791f8fdcb2a88f4bfe8bcd297fd844bef0361faa479551fb8963b2a15f9c3b2bb29a03662824a1c89044db49f53fbba7e3f&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20UK&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2026-04-22 13:11:00 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=959740332&visitor_id_sign=7cf25791f8fdcb2a88f4bfe8bcd297fd844bef0361faa479551fb8963b2a15f9c3b2bb29a03662824a1c89044db49f53fbba7e3f&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20UK&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2026-04-22 13:11:05 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/account/login> (resource type: document, referrer: https://www.manheim.co.uk/)
2026-04-22 13:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): publicsuffix.org:443
2026-04-22 13:11:10 [urllib3.connectionpool] DEBUG: https://publicsuffix.org:443 "GET /list/public_suffix_list.dat HTTP/1.1" 200 87846
2026-04-22 13:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk> (referer: None) ['playwright']
2026-04-22 13:11:10 [manheim.gb] INFO: Cookies from Playwright: [{'name': 'ASP.NET_SessionId', 'value': 'zbs0c0qivcqn4epy0tutspuw', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'Lax'}, {'name': '__RequestVerificationToken', 'value': 'zkPqztBV7qmmwPyBWjVkmdkg_1taD2PRp47ZeqbzkkSTJWex1GszmQYo5xW32HDyJaiFK-6jIOEBl5qzoB53Xph9FpI1', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1808399454, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '959740332', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1808399458, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '7cf25791f8fdcb2a88f4bfe8bcd297fd844bef0361faa479551fb8963b2a15f9c3b2bb29a03662824a1c89044db49f53fbba7e3f', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1808399458, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '959740332', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1808399460, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '7cf25791f8fdcb2a88f4bfe8bcd297fd844bef0361faa479551fb8963b2a15f9c3b2bb29a03662824a1c89044db49f53fbba7e3f', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1808399460, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '959740332', 'domain': '.pardot.com', 'path': '/', 'expires': 1808399458, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '7cf25791f8fdcb2a88f4bfe8bcd297fd844bef0361faa479551fb8963b2a15f9c3b2bb29a03662824a1c89044db49f53fbba7e3f', 'domain': '.pardot.com', 'path': '/', 'expires': 1808399458, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay8%3D', 'domain': 'pi.pardot.com', 'path': '/', 'expires': 1776865258, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-04-22 13:11:10 [manheim.gb] INFO: Scrapy-formatted cookies: [{'name': 'ASP.NET_SessionId', 'value': 'zbs0c0qivcqn4epy0tutspuw', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': '__RequestVerificationToken', 'value': 'zkPqztBV7qmmwPyBWjVkmdkg_1taD2PRp47ZeqbzkkSTJWex1GszmQYo5xW32HDyJaiFK-6jIOEBl5qzoB53Xph9FpI1', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '959740332', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '7cf25791f8fdcb2a88f4bfe8bcd297fd844bef0361faa479551fb8963b2a15f9c3b2bb29a03662824a1c89044db49f53fbba7e3f', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '959740332', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '7cf25791f8fdcb2a88f4bfe8bcd297fd844bef0361faa479551fb8963b2a15f9c3b2bb29a03662824a1c89044db49f53fbba7e3f', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '959740332', 'domain': '.pardot.com', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '7cf25791f8fdcb2a88f4bfe8bcd297fd844bef0361faa479551fb8963b2a15f9c3b2bb29a03662824a1c89044db49f53fbba7e3f', 'domain': '.pardot.com', 'path': '/'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay8%3D', 'domain': 'pi.pardot.com', 'path': '/'}]
2026-04-22 13:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:11 [manheim.gb] INFO: Page 1: 100 results (total: 14785)
2026-04-22 13:11:11 [manheim.gb] INFO: Found listing with ID: 1000824
2026-04-22 13:11:11 [manheim.gb] INFO: Scrape type for 1000824: 0
2026-04-22 13:11:11 [manheim.gb] INFO: Found listing with ID: 1005802
2026-04-22 13:11:11 [manheim.gb] INFO: Scrape type for 1005802: 1
2026-04-22 13:11:11 [manheim.gb] INFO: Found listing with ID: 1047226
2026-04-22 13:11:11 [manheim.gb] INFO: Scrape type for 1047226: 1
2026-04-22 13:11:11 [manheim.gb] INFO: Found listing with ID: 1049036
2026-04-22 13:11:11 [manheim.gb] INFO: Scrape type for 1049036: 1
2026-04-22 13:11:11 [manheim.gb] INFO: Found listing with ID: 1061869
2026-04-22 13:11:11 [manheim.gb] INFO: Scrape type for 1061869: 1
2026-04-22 13:11:11 [manheim.gb] INFO: Found listing with ID: 1065229
2026-04-22 13:11:11 [manheim.gb] INFO: Scrape type for 1065229: 1
2026-04-22 13:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:11 [manheim.gb] INFO: Found listing with ID: 1066280
2026-04-22 13:11:11 [manheim.gb] INFO: Scrape type for 1066280: 0
2026-04-22 13:11:11 [manheim.gb] INFO: Found listing with ID: 1069521
2026-04-22 13:11:11 [manheim.gb] INFO: Scrape type for 1069521: 1
2026-04-22 13:11:11 [manheim.gb] INFO: Found listing with ID: 108117
2026-04-22 13:11:11 [manheim.gb] INFO: Scrape type for 108117: 0
2026-04-22 13:11:11 [manheim.gb] INFO: Found listing with ID: 1086346
2026-04-22 13:11:11 [manheim.gb] INFO: Scrape type for 1086346: 1
2026-04-22 13:11:11 [manheim.gb] INFO: Found listing with ID: 1097155
2026-04-22 13:11:11 [manheim.gb] INFO: Scrape type for 1097155: 0
2026-04-22 13:11:11 [manheim.gb] INFO: Found listing with ID: 109897
2026-04-22 13:11:11 [manheim.gb] INFO: Scrape type for 109897: 1
2026-04-22 13:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261df138-3784-590c-ae3b-011a6f04312b with identifier: 1005802
2026-04-22 13:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 261df138-3784-590c-ae3b-011a6f04312b with scrape type 1
2026-04-22 13:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 261df138-3784-590c-ae3b-011a6f04312b
2026-04-22 13:11:11 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 261df138-3784-590c-ae3b-011a6f04312b
2026-04-22 13:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 261df138-3784-590c-ae3b-011a6f04312b, identifier: 1005802
2026-04-22 13:11:12 [manheim.gb] INFO: Found listing with ID: 1100025
2026-04-22 13:11:12 [manheim.gb] INFO: Scrape type for 1100025: 1
2026-04-22 13:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 261df138-3784-590c-ae3b-011a6f04312b with identifier: 1005802
2026-04-22 13:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2026-04-22 13:11:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2026-04-22 13:11:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 261df138-3784-590c-ae3b-011a6f04312b with identifier: 1005802
2026-04-22 13:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 261df138-3784-590c-ae3b-011a6f04312b with identifier: 1005802 to the API
2026-04-22 13:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:12 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 261df138-3784-590c-ae3b-011a6f04312b: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:12 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:12 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:12 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '261df138-3784-590c-ae3b-011a6f04312b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WJ64BWA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=1005802',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-09-30',
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO 1.0 S 3dr',
 'transmission': 'manual',
 'trim': '1.0 S 3dr',
 'year': 2014}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:12 [manheim.gb] INFO: Saving data for 1005802: {'created_time': 1776863472.732681, 'last_price_update_time': 1776863472.732695}
2026-04-22 13:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:12 [manheim.gb] INFO: Found listing with ID: 1102904
2026-04-22 13:11:12 [manheim.gb] INFO: Scrape type for 1102904: 1
2026-04-22 13:11:12 [manheim.gb] INFO: Found listing with ID: 1106983
2026-04-22 13:11:12 [manheim.gb] INFO: Scrape type for 1106983: 1
2026-04-22 13:11:12 [manheim.gb] INFO: Found listing with ID: 1109266
2026-04-22 13:11:12 [manheim.gb] INFO: Scrape type for 1109266: 0
2026-04-22 13:11:12 [manheim.gb] INFO: Found listing with ID: 1110230
2026-04-22 13:11:12 [manheim.gb] INFO: Scrape type for 1110230: 1
2026-04-22 13:11:12 [manheim.gb] INFO: Found listing with ID: 1113172
2026-04-22 13:11:12 [manheim.gb] INFO: Scrape type for 1113172: 0
2026-04-22 13:11:12 [manheim.gb] INFO: Found listing with ID: 1116994
2026-04-22 13:11:12 [manheim.gb] INFO: Scrape type for 1116994: 0
2026-04-22 13:11:12 [manheim.gb] INFO: Found listing with ID: 1124728
2026-04-22 13:11:13 [manheim.gb] INFO: Scrape type for 1124728: 1
2026-04-22 13:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:13 [manheim.gb] INFO: Found listing with ID: 1135151
2026-04-22 13:11:13 [manheim.gb] INFO: Scrape type for 1135151: 0
2026-04-22 13:11:13 [manheim.gb] INFO: Found listing with ID: 1146894
2026-04-22 13:11:13 [manheim.gb] INFO: Scrape type for 1146894: 1
2026-04-22 13:11:13 [manheim.gb] INFO: Found listing with ID: 1148103
2026-04-22 13:11:13 [manheim.gb] INFO: Scrape type for 1148103: 1
2026-04-22 13:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43fc70ee-6648-509a-9070-2ab2ed0fcbd3 with identifier: 1047226
2026-04-22 13:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43fc70ee-6648-509a-9070-2ab2ed0fcbd3 with scrape type 1
2026-04-22 13:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 43fc70ee-6648-509a-9070-2ab2ed0fcbd3
2026-04-22 13:11:13 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 43fc70ee-6648-509a-9070-2ab2ed0fcbd3
2026-04-22 13:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 43fc70ee-6648-509a-9070-2ab2ed0fcbd3, identifier: 1047226
2026-04-22 13:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed997dd-4bf2-5318-a7ff-39d61569f49e with identifier: 1065229
2026-04-22 13:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed997dd-4bf2-5318-a7ff-39d61569f49e with scrape type 1
2026-04-22 13:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item fed997dd-4bf2-5318-a7ff-39d61569f49e
2026-04-22 13:11:13 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item fed997dd-4bf2-5318-a7ff-39d61569f49e
2026-04-22 13:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fed997dd-4bf2-5318-a7ff-39d61569f49e, identifier: 1065229
2026-04-22 13:11:13 [manheim.gb] INFO: Found listing with ID: 1160383
2026-04-22 13:11:13 [manheim.gb] INFO: Scrape type for 1160383: 0
2026-04-22 13:11:13 [manheim.gb] INFO: Found listing with ID: 11629
2026-04-22 13:11:13 [manheim.gb] INFO: Scrape type for 11629: 1
2026-04-22 13:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 43fc70ee-6648-509a-9070-2ab2ed0fcbd3 with identifier: 1047226
2026-04-22 13:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2026-04-22 13:11:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 43fc70ee-6648-509a-9070-2ab2ed0fcbd3 with identifier: 1047226
2026-04-22 13:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 43fc70ee-6648-509a-9070-2ab2ed0fcbd3 with identifier: 1047226 to the API
2026-04-22 13:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:13 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 43fc70ee-6648-509a-9070-2ab2ed0fcbd3: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:13 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:13 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:13 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '43fc70ee-6648-509a-9070-2ab2ed0fcbd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'CV65WCX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1047226',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-10-20',
 'seller_name': None,
 'title': 'FORD FOCUS 2.0T EcoBoost ST-2 5dr',
 'transmission': 'manual',
 'trim': '2.0T EcoBoost ST-2 5dr',
 'year': 2015}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:13 [manheim.gb] INFO: Saving data for 1047226: {'created_time': 1776863473.751227, 'last_price_update_time': 1776863473.75124}
2026-04-22 13:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fed997dd-4bf2-5318-a7ff-39d61569f49e with identifier: 1065229
2026-04-22 13:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2026-04-22 13:11:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2026-04-22 13:11:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fed997dd-4bf2-5318-a7ff-39d61569f49e with identifier: 1065229
2026-04-22 13:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: fed997dd-4bf2-5318-a7ff-39d61569f49e with identifier: 1065229 to the API
2026-04-22 13:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:14 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id fed997dd-4bf2-5318-a7ff-39d61569f49e: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:14 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:14 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:14 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'fed997dd-4bf2-5318-a7ff-39d61569f49e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'SO64BYY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=1065229',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-10-14',
 'seller_name': None,
 'title': 'FORD FIESTA 1.5 TDCi Zetec 3dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi Zetec 3dr',
 'year': 2014}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:14 [manheim.gb] INFO: Saving data for 1065229: {'created_time': 1776863474.588165, 'last_price_update_time': 1776863474.588175}
2026-04-22 13:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:14 [manheim.gb] INFO: Found listing with ID: 1175109
2026-04-22 13:11:14 [manheim.gb] INFO: Scrape type for 1175109: 1
2026-04-22 13:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e37fdf8-51de-579c-91c6-98c9a4fd21a8 with identifier: 1102904
2026-04-22 13:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8 with scrape type 1
2026-04-22 13:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8
2026-04-22 13:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-004.jpg not downloaded yet
2026-04-22 13:11:14 [manheim.gb] INFO: Found listing with ID: 1178417
2026-04-22 13:11:14 [manheim.gb] INFO: Scrape type for 1178417: 0
2026-04-22 13:11:14 [manheim.gb] INFO: Found listing with ID: 1180698
2026-04-22 13:11:14 [manheim.gb] INFO: Scrape type for 1180698: 0
2026-04-22 13:11:14 [manheim.gb] INFO: Found listing with ID: 11807
2026-04-22 13:11:14 [manheim.gb] INFO: Scrape type for 11807: 0
2026-04-22 13:11:14 [manheim.gb] INFO: Found listing with ID: 1192403
2026-04-22 13:11:14 [manheim.gb] INFO: Scrape type for 1192403: 0
2026-04-22 13:11:14 [manheim.gb] INFO: Found listing with ID: 1192441
2026-04-22 13:11:14 [manheim.gb] INFO: Scrape type for 1192441: 1
2026-04-22 13:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-008.jpg not downloaded yet
2026-04-22 13:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:14 [manheim.gb] INFO: Found listing with ID: 1195074
2026-04-22 13:11:14 [manheim.gb] INFO: Scrape type for 1195074: 1
2026-04-22 13:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-001.jpg not downloaded yet
2026-04-22 13:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdaa6358-1254-5423-ad98-5d3ca4ec4550 with identifier: 1100025
2026-04-22 13:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdaa6358-1254-5423-ad98-5d3ca4ec4550 with scrape type 1
2026-04-22 13:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item fdaa6358-1254-5423-ad98-5d3ca4ec4550
2026-04-22 13:11:14 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item fdaa6358-1254-5423-ad98-5d3ca4ec4550
2026-04-22 13:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fdaa6358-1254-5423-ad98-5d3ca4ec4550, identifier: 1100025
2026-04-22 13:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db272436-f580-5f38-b48a-e4f2a6b3bff9 with identifier: 109897
2026-04-22 13:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db272436-f580-5f38-b48a-e4f2a6b3bff9 with scrape type 1
2026-04-22 13:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item db272436-f580-5f38-b48a-e4f2a6b3bff9
2026-04-22 13:11:14 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item db272436-f580-5f38-b48a-e4f2a6b3bff9
2026-04-22 13:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: db272436-f580-5f38-b48a-e4f2a6b3bff9, identifier: 109897
2026-04-22 13:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bee51b3-5d5f-59f8-9279-438fee40304e with identifier: 1086346
2026-04-22 13:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bee51b3-5d5f-59f8-9279-438fee40304e with scrape type 1
2026-04-22 13:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 0bee51b3-5d5f-59f8-9279-438fee40304e
2026-04-22 13:11:15 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 0bee51b3-5d5f-59f8-9279-438fee40304e
2026-04-22 13:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0bee51b3-5d5f-59f8-9279-438fee40304e, identifier: 1086346
2026-04-22 13:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0c1b9ed-9010-5c88-b490-a104b20d4827 with identifier: 1061869
2026-04-22 13:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0c1b9ed-9010-5c88-b490-a104b20d4827 with scrape type 1
2026-04-22 13:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item c0c1b9ed-9010-5c88-b490-a104b20d4827
2026-04-22 13:11:15 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item c0c1b9ed-9010-5c88-b490-a104b20d4827
2026-04-22 13:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c0c1b9ed-9010-5c88-b490-a104b20d4827, identifier: 1061869
2026-04-22 13:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7e14870-91df-504c-99e1-28ce93584eb9 with identifier: 1110230
2026-04-22 13:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e14870-91df-504c-99e1-28ce93584eb9 with scrape type 1
2026-04-22 13:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a7e14870-91df-504c-99e1-28ce93584eb9
2026-04-22 13:11:15 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a7e14870-91df-504c-99e1-28ce93584eb9
2026-04-22 13:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a7e14870-91df-504c-99e1-28ce93584eb9, identifier: 1110230
2026-04-22 13:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f05ae477-1b43-5863-bafb-f22b2a8b576a with identifier: 1049036
2026-04-22 13:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f05ae477-1b43-5863-bafb-f22b2a8b576a with scrape type 1
2026-04-22 13:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f05ae477-1b43-5863-bafb-f22b2a8b576a
2026-04-22 13:11:15 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f05ae477-1b43-5863-bafb-f22b2a8b576a
2026-04-22 13:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f05ae477-1b43-5863-bafb-f22b2a8b576a, identifier: 1049036
2026-04-22 13:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6efdcb41-baa8-57d5-b29e-59f9b279dcbe with identifier: 1069521
2026-04-22 13:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6efdcb41-baa8-57d5-b29e-59f9b279dcbe with scrape type 1
2026-04-22 13:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6efdcb41-baa8-57d5-b29e-59f9b279dcbe
2026-04-22 13:11:15 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6efdcb41-baa8-57d5-b29e-59f9b279dcbe
2026-04-22 13:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6efdcb41-baa8-57d5-b29e-59f9b279dcbe, identifier: 1069521
2026-04-22 13:11:15 [manheim.gb] INFO: Found listing with ID: 1206937
2026-04-22 13:11:15 [manheim.gb] INFO: Scrape type for 1206937: 0
2026-04-22 13:11:15 [manheim.gb] INFO: Found listing with ID: 1206981
2026-04-22 13:11:15 [manheim.gb] INFO: Scrape type for 1206981: 1
2026-04-22 13:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fdaa6358-1254-5423-ad98-5d3ca4ec4550 with identifier: 1100025
2026-04-22 13:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fdaa6358-1254-5423-ad98-5d3ca4ec4550 with identifier: 1100025
2026-04-22 13:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: fdaa6358-1254-5423-ad98-5d3ca4ec4550 with identifier: 1100025 to the API
2026-04-22 13:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:15 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id fdaa6358-1254-5423-ad98-5d3ca4ec4550: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:15 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:15 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:15 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'fdaa6358-1254-5423-ad98-5d3ca4ec4550',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'AK14GZB',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/YETI?id=1100025',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'SKODA',
 'model': 'YETI',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-04-30',
 'seller_name': None,
 'title': 'SKODA YETI 2.0 TDI CR SE 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI CR SE 5dr',
 'year': 2014}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:15 [manheim.gb] INFO: Saving data for 1100025: {'created_time': 1776863475.933904, 'last_price_update_time': 1776863475.933916}
2026-04-22 13:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: db272436-f580-5f38-b48a-e4f2a6b3bff9 with identifier: 109897
2026-04-22 13:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: db272436-f580-5f38-b48a-e4f2a6b3bff9 with identifier: 109897
2026-04-22 13:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: db272436-f580-5f38-b48a-e4f2a6b3bff9 with identifier: 109897 to the API
2026-04-22 13:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:16 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id db272436-f580-5f38-b48a-e4f2a6b3bff9: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:15 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:16 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:16 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'db272436-f580-5f38-b48a-e4f2a6b3bff9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'LO11LJL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A4?id=109897',
 'listing': 'auction',
 'location': 'Manchester - In Transit',
 'longitude': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2011-07-02',
 'seller_name': None,
 'title': 'AUDI A4 2.0 TDI Quattro 170 Black Edition 4dr [Start Stop]',
 'transmission': 'manual',
 'trim': '2.0 TDI Quattro 170 Black Edition 4dr [Start Stop]',
 'year': 2011}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:16 [manheim.gb] INFO: Saving data for 109897: {'created_time': 1776863476.255285, 'last_price_update_time': 1776863476.255296}
2026-04-22 13:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0bee51b3-5d5f-59f8-9279-438fee40304e with identifier: 1086346
2026-04-22 13:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2026-04-22 13:11:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0bee51b3-5d5f-59f8-9279-438fee40304e with identifier: 1086346
2026-04-22 13:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0bee51b3-5d5f-59f8-9279-438fee40304e with identifier: 1086346 to the API
2026-04-22 13:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '0bee51b3-5d5f-59f8-9279-438fee40304e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'NV15HCK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=1086346',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 75207,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-06-05',
 'seller_name': None,
 'title': 'VAUXHALL CORSA 1.2 Sting 3dr',
 'transmission': 'manual',
 'trim': '1.2 Sting 3dr',
 'year': 2015}
2026-04-22 13:11:17 [manheim.gb] INFO: Saving data for 1086346: {'created_time': 1776863477.180424, 'last_price_update_time': 1776863477.180436}
2026-04-22 13:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c0c1b9ed-9010-5c88-b490-a104b20d4827 with identifier: 1061869
2026-04-22 13:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2026-04-22 13:11:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c0c1b9ed-9010-5c88-b490-a104b20d4827 with identifier: 1061869
2026-04-22 13:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: c0c1b9ed-9010-5c88-b490-a104b20d4827 with identifier: 1061869 to the API
2026-04-22 13:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:17 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id c0c1b9ed-9010-5c88-b490-a104b20d4827: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:17 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:17 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:17 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'c0c1b9ed-9010-5c88-b490-a104b20d4827',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'SL60TJV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/SERIES?id=1061869',
 'listing': 'auction',
 'location': 'Manchester - In Transit',
 'longitude': None,
 'make': 'BMW',
 'model': 'SERIES',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2010-09-30',
 'seller_name': None,
 'title': 'BMW SERIES 118d Sport 2dr',
 'transmission': 'manual',
 'trim': '118d Sport 2dr',
 'year': 2010}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:17 [manheim.gb] INFO: Saving data for 1061869: {'created_time': 1776863477.651522, 'last_price_update_time': 1776863477.65161}
2026-04-22 13:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a7e14870-91df-504c-99e1-28ce93584eb9 with identifier: 1110230
2026-04-22 13:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2026-04-22 13:11:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a7e14870-91df-504c-99e1-28ce93584eb9 with identifier: 1110230
2026-04-22 13:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a7e14870-91df-504c-99e1-28ce93584eb9 with identifier: 1110230 to the API
2026-04-22 13:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'a7e14870-91df-504c-99e1-28ce93584eb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'FL13CWZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A6?id=1110230',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'AUDI',
 'model': 'A6',
 'odometer': 121073,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-04-30',
 'seller_name': None,
 'title': 'AUDI A6 2.0 TDI SE 4dr',
 'transmission': 'manual',
 'trim': '2.0 TDI SE 4dr',
 'year': 2013}
2026-04-22 13:11:18 [manheim.gb] INFO: Saving data for 1110230: {'created_time': 1776863478.107969, 'last_price_update_time': 1776863478.107981}
2026-04-22 13:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f05ae477-1b43-5863-bafb-f22b2a8b576a with identifier: 1049036
2026-04-22 13:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f05ae477-1b43-5863-bafb-f22b2a8b576a with identifier: 1049036
2026-04-22 13:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f05ae477-1b43-5863-bafb-f22b2a8b576a with identifier: 1049036 to the API
2026-04-22 13:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:18 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id f05ae477-1b43-5863-bafb-f22b2a8b576a: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:17 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:18 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:18 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'f05ae477-1b43-5863-bafb-f22b2a8b576a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'PJ14FPG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/OCTAVIA?id=1049036',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'SKODA',
 'model': 'OCTAVIA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-05-29',
 'seller_name': None,
 'title': 'SKODA OCTAVIA 1.6 TDI CR SE 4x4 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDI CR SE 4x4 5dr',
 'year': 2014}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:18 [manheim.gb] INFO: Saving data for 1049036: {'created_time': 1776863478.422596, 'last_price_update_time': 1776863478.422611}
2026-04-22 13:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6efdcb41-baa8-57d5-b29e-59f9b279dcbe with identifier: 1069521
2026-04-22 13:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6efdcb41-baa8-57d5-b29e-59f9b279dcbe with identifier: 1069521
2026-04-22 13:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 6efdcb41-baa8-57d5-b29e-59f9b279dcbe with identifier: 1069521 to the API
2026-04-22 13:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '6efdcb41-baa8-57d5-b29e-59f9b279dcbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'SB63LWK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=1069521',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 99904,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-11-28',
 'seller_name': None,
 'title': 'FIAT 500 1.2 Pop 3dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.2 Pop 3dr [Start Stop]',
 'year': 2013}
2026-04-22 13:11:19 [manheim.gb] INFO: Saving data for 1069521: {'created_time': 1776863479.375405, 'last_price_update_time': 1776863479.375419}
2026-04-22 13:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-002.jpg not downloaded yet
2026-04-22 13:11:19 [manheim.gb] INFO: Found listing with ID: 1210667
2026-04-22 13:11:19 [manheim.gb] INFO: Scrape type for 1210667: 0
2026-04-22 13:11:19 [manheim.gb] INFO: Found listing with ID: 1211830
2026-04-22 13:11:19 [manheim.gb] INFO: Scrape type for 1211830: 0
2026-04-22 13:11:19 [manheim.gb] INFO: Found listing with ID: 121828
2026-04-22 13:11:19 [manheim.gb] INFO: Scrape type for 121828: 1
2026-04-22 13:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5 with identifier: 1124728
2026-04-22 13:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5 with scrape type 1
2026-04-22 13:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5
2026-04-22 13:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_7.jpg not downloaded yet
2026-04-22 13:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fef655f-6a22-5f00-b514-9e28d50d9ecd with identifier: 1146894
2026-04-22 13:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fef655f-6a22-5f00-b514-9e28d50d9ecd with scrape type 1
2026-04-22 13:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2fef655f-6a22-5f00-b514-9e28d50d9ecd
2026-04-22 13:11:19 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2fef655f-6a22-5f00-b514-9e28d50d9ecd
2026-04-22 13:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2fef655f-6a22-5f00-b514-9e28d50d9ecd, identifier: 1146894
2026-04-22 13:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-003.jpg not downloaded yet
2026-04-22 13:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2fef655f-6a22-5f00-b514-9e28d50d9ecd with identifier: 1146894
2026-04-22 13:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Purple HTTP/1.1" 200 None
2026-04-22 13:11:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2fef655f-6a22-5f00-b514-9e28d50d9ecd with identifier: 1146894
2026-04-22 13:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 2fef655f-6a22-5f00-b514-9e28d50d9ecd with identifier: 1146894 to the API
2026-04-22 13:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'Purple',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '2fef655f-6a22-5f00-b514-9e28d50d9ecd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YA16CXV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/DS/DS%203?id=1146894',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'DS',
 'model': 'DS 3',
 'odometer': 67745,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-06-30',
 'seller_name': None,
 'title': 'DS DS 3 1.2 PureTech 82 Chic 3dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 82 Chic 3dr',
 'year': 2016}
2026-04-22 13:11:20 [manheim.gb] INFO: Saving data for 1146894: {'created_time': 1776863480.243359, 'last_price_update_time': 1776863480.243374}
2026-04-22 13:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:20 [manheim.gb] INFO: Found listing with ID: 1226131
2026-04-22 13:11:20 [manheim.gb] INFO: Scrape type for 1226131: 0
2026-04-22 13:11:20 [manheim.gb] INFO: Found listing with ID: 1227618
2026-04-22 13:11:20 [manheim.gb] INFO: Scrape type for 1227618: 1
2026-04-22 13:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_7.jpg not downloaded yet
2026-04-22 13:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-005.jpg not downloaded yet
2026-04-22 13:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4803a32c-6303-5e7c-9503-c0a1c9639a7e with identifier: 1175109
2026-04-22 13:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4803a32c-6303-5e7c-9503-c0a1c9639a7e with scrape type 1
2026-04-22 13:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 4803a32c-6303-5e7c-9503-c0a1c9639a7e
2026-04-22 13:11:20 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 4803a32c-6303-5e7c-9503-c0a1c9639a7e
2026-04-22 13:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4803a32c-6303-5e7c-9503-c0a1c9639a7e, identifier: 1175109
2026-04-22 13:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8263fd1-6967-586d-81bc-4799d1a245ac with identifier: 1148103
2026-04-22 13:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8263fd1-6967-586d-81bc-4799d1a245ac with scrape type 1
2026-04-22 13:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item d8263fd1-6967-586d-81bc-4799d1a245ac
2026-04-22 13:11:20 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item d8263fd1-6967-586d-81bc-4799d1a245ac
2026-04-22 13:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d8263fd1-6967-586d-81bc-4799d1a245ac, identifier: 1148103
2026-04-22 13:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 937c4855-e6ce-571f-a977-6c54701e33ed with identifier: 1106983
2026-04-22 13:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 937c4855-e6ce-571f-a977-6c54701e33ed with scrape type 1
2026-04-22 13:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 937c4855-e6ce-571f-a977-6c54701e33ed
2026-04-22 13:11:20 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 937c4855-e6ce-571f-a977-6c54701e33ed
2026-04-22 13:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 937c4855-e6ce-571f-a977-6c54701e33ed, identifier: 1106983
2026-04-22 13:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 446901d3-77be-5c27-918b-24a28ef28e94 with identifier: 11629
2026-04-22 13:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446901d3-77be-5c27-918b-24a28ef28e94 with scrape type 1
2026-04-22 13:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 446901d3-77be-5c27-918b-24a28ef28e94
2026-04-22 13:11:20 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 446901d3-77be-5c27-918b-24a28ef28e94
2026-04-22 13:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 446901d3-77be-5c27-918b-24a28ef28e94, identifier: 11629
2026-04-22 13:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:20 [manheim.gb] INFO: Found listing with ID: 1232447
2026-04-22 13:11:20 [manheim.gb] INFO: Scrape type for 1232447: 0
2026-04-22 13:11:20 [manheim.gb] INFO: Found listing with ID: 123379
2026-04-22 13:11:20 [manheim.gb] INFO: Scrape type for 123379: 1
2026-04-22 13:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_6.jpg not downloaded yet
2026-04-22 13:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4803a32c-6303-5e7c-9503-c0a1c9639a7e with identifier: 1175109
2026-04-22 13:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4803a32c-6303-5e7c-9503-c0a1c9639a7e with identifier: 1175109
2026-04-22 13:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 4803a32c-6303-5e7c-9503-c0a1c9639a7e with identifier: 1175109 to the API
2026-04-22 13:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:21 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 4803a32c-6303-5e7c-9503-c0a1c9639a7e: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:20 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:21 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:21 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '4803a32c-6303-5e7c-9503-c0a1c9639a7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'SF14BTG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=1175109',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-08-19',
 'seller_name': None,
 'title': 'VAUXHALL CORSA 1.2 Limited Edition 3dr',
 'transmission': 'manual',
 'trim': '1.2 Limited Edition 3dr',
 'year': 2014}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:21 [manheim.gb] INFO: Saving data for 1175109: {'created_time': 1776863481.22386, 'last_price_update_time': 1776863481.22387}
2026-04-22 13:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d8263fd1-6967-586d-81bc-4799d1a245ac with identifier: 1148103
2026-04-22 13:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d8263fd1-6967-586d-81bc-4799d1a245ac with identifier: 1148103
2026-04-22 13:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: d8263fd1-6967-586d-81bc-4799d1a245ac with identifier: 1148103 to the API
2026-04-22 13:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'd8263fd1-6967-586d-81bc-4799d1a245ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WK06LHM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF%20PLUS?id=1148103',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF PLUS',
 'odometer': 666,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2006-03-02',
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF PLUS 1.6 TDI 105 SE 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.6 TDI 105 SE 5dr DSG',
 'year': 2006}
2026-04-22 13:11:21 [manheim.gb] INFO: Saving data for 1148103: {'created_time': 1776863481.621194, 'last_price_update_time': 1776863481.621205}
2026-04-22 13:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 937c4855-e6ce-571f-a977-6c54701e33ed with identifier: 1106983
2026-04-22 13:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 937c4855-e6ce-571f-a977-6c54701e33ed with identifier: 1106983
2026-04-22 13:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 937c4855-e6ce-571f-a977-6c54701e33ed with identifier: 1106983 to the API
2026-04-22 13:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '937c4855-e6ce-571f-a977-6c54701e33ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'NG14ONT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ADAM?id=1106983',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'ADAM',
 'odometer': 81818,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-07-22',
 'seller_name': None,
 'title': 'VAUXHALL ADAM 1.2i Jam 3dr',
 'transmission': 'manual',
 'trim': '1.2i Jam 3dr',
 'year': 2014}
2026-04-22 13:11:21 [manheim.gb] INFO: Saving data for 1106983: {'created_time': 1776863481.968619, 'last_price_update_time': 1776863481.96863}
2026-04-22 13:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 446901d3-77be-5c27-918b-24a28ef28e94 with identifier: 11629
2026-04-22 13:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 446901d3-77be-5c27-918b-24a28ef28e94 with identifier: 11629
2026-04-22 13:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 446901d3-77be-5c27-918b-24a28ef28e94 with identifier: 11629 to the API
2026-04-22 13:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:22 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 446901d3-77be-5c27-918b-24a28ef28e94: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:21 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:22 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:22 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '446901d3-77be-5c27-918b-24a28ef28e94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'SP60NDU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=11629',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2010-09-01',
 'seller_name': None,
 'title': 'FORD FIESTA 1.6 Zetec S 3dr',
 'transmission': 'manual',
 'trim': '1.6 Zetec S 3dr',
 'year': 2010}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:22 [manheim.gb] INFO: Saving data for 11629: {'created_time': 1776863482.311762, 'last_price_update_time': 1776863482.311773}
2026-04-22 13:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-006.jpg not downloaded yet
2026-04-22 13:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-004.jpg> (referer: None)
2026-04-22 13:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:22 [manheim.gb] INFO: Found listing with ID: 1235129
2026-04-22 13:11:22 [manheim.gb] INFO: Scrape type for 1235129: 0
2026-04-22 13:11:22 [manheim.gb] INFO: Found listing with ID: 1241939
2026-04-22 13:11:22 [manheim.gb] INFO: Scrape type for 1241939: 1
2026-04-22 13:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_1.jpg not downloaded yet
2026-04-22 13:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd432a87-7eea-5dd7-839c-e4bbe99f9474 with identifier: 1192441
2026-04-22 13:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd432a87-7eea-5dd7-839c-e4bbe99f9474 with scrape type 1
2026-04-22 13:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item bd432a87-7eea-5dd7-839c-e4bbe99f9474
2026-04-22 13:11:22 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item bd432a87-7eea-5dd7-839c-e4bbe99f9474
2026-04-22 13:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: bd432a87-7eea-5dd7-839c-e4bbe99f9474, identifier: 1192441
2026-04-22 13:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1257fb17-88a0-5df8-b528-bd60404b062e with identifier: 1195074
2026-04-22 13:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1257fb17-88a0-5df8-b528-bd60404b062e with scrape type 1
2026-04-22 13:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 1257fb17-88a0-5df8-b528-bd60404b062e
2026-04-22 13:11:22 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 1257fb17-88a0-5df8-b528-bd60404b062e
2026-04-22 13:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1257fb17-88a0-5df8-b528-bd60404b062e, identifier: 1195074
2026-04-22 13:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-007.jpg not downloaded yet
2026-04-22 13:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: bd432a87-7eea-5dd7-839c-e4bbe99f9474 with identifier: 1192441
2026-04-22 13:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: bd432a87-7eea-5dd7-839c-e4bbe99f9474 with identifier: 1192441
2026-04-22 13:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: bd432a87-7eea-5dd7-839c-e4bbe99f9474 with identifier: 1192441 to the API
2026-04-22 13:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:23 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id bd432a87-7eea-5dd7-839c-e4bbe99f9474: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:22 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:23 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:23 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester - In Transit',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'bd432a87-7eea-5dd7-839c-e4bbe99f9474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'EJ16YLM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/DIESEL?id=1192441',
 'listing': 'auction',
 'location': 'Manchester - In Transit',
 'longitude': None,
 'make': 'HYUNDAI',
 'model': 'DIESEL',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-04-29',
 'seller_name': None,
 'title': 'HYUNDAI DIESEL 2.2 CRDi Blue Drive Premium 5dr Auto [5 Seats]',
 'transmission': 'automatic',
 'trim': '2.2 CRDi Blue Drive Premium 5dr Auto [5 Seats]',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:23 [manheim.gb] INFO: Saving data for 1192441: {'created_time': 1776863483.050132, 'last_price_update_time': 1776863483.050146}
2026-04-22 13:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1257fb17-88a0-5df8-b528-bd60404b062e with identifier: 1195074
2026-04-22 13:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1257fb17-88a0-5df8-b528-bd60404b062e with identifier: 1195074
2026-04-22 13:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 1257fb17-88a0-5df8-b528-bd60404b062e with identifier: 1195074 to the API
2026-04-22 13:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:23 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 1257fb17-88a0-5df8-b528-bd60404b062e: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:22 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:23 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:23 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '1257fb17-88a0-5df8-b528-bd60404b062e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'AJ16OHR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=1195074',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-07-13',
 'seller_name': None,
 'title': 'MINI HATCHBACK 1.5 Cooper 5dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper 5dr',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:23 [manheim.gb] INFO: Saving data for 1195074: {'created_time': 1776863483.363691, 'last_price_update_time': 1776863483.363709}
2026-04-22 13:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fed2659-65ca-5473-94b0-aa6867bd4d90 with identifier: 1206981
2026-04-22 13:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fed2659-65ca-5473-94b0-aa6867bd4d90 with scrape type 1
2026-04-22 13:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3fed2659-65ca-5473-94b0-aa6867bd4d90
2026-04-22 13:11:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3fed2659-65ca-5473-94b0-aa6867bd4d90
2026-04-22 13:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3fed2659-65ca-5473-94b0-aa6867bd4d90, identifier: 1206981
2026-04-22 13:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-008.jpg> (referer: None)
2026-04-22 13:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:23 [manheim.gb] INFO: Found listing with ID: 1242953
2026-04-22 13:11:23 [manheim.gb] INFO: Scrape type for 1242953: 0
2026-04-22 13:11:23 [manheim.gb] INFO: Found listing with ID: 1249271
2026-04-22 13:11:23 [manheim.gb] INFO: Scrape type for 1249271: 1
2026-04-22 13:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_5.jpg not downloaded yet
2026-04-22 13:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3fed2659-65ca-5473-94b0-aa6867bd4d90 with identifier: 1206981
2026-04-22 13:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3fed2659-65ca-5473-94b0-aa6867bd4d90 with identifier: 1206981
2026-04-22 13:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 3fed2659-65ca-5473-94b0-aa6867bd4d90 with identifier: 1206981 to the API
2026-04-22 13:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '3fed2659-65ca-5473-94b0-aa6867bd4d90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'MT65LHB',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/PULSAR?id=1206981',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'PULSAR',
 'odometer': 69243,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-09-29',
 'seller_name': None,
 'title': 'NISSAN PULSAR 1.2 DiG-T Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T Tekna 5dr',
 'year': 2015}
2026-04-22 13:11:23 [manheim.gb] INFO: Saving data for 1206981: {'created_time': 1776863483.928514, 'last_price_update_time': 1776863483.928528}
2026-04-22 13:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-001.jpg> (referer: None)
2026-04-22 13:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-009.jpg not downloaded yet
2026-04-22 13:11:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-04-22 13:11:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 36f195bf-b061-498b-bebd-997f7853af90
2026-04-22 13:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0620450>
2026-04-22 13:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-04-22 13:11:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2106
2026-04-22 13:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxdev.blob.core.windows.net:443
2026-04-22 13:11:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-004.jpg saved to cache
2026-04-22 13:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8
2026-04-22 13:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72380996-2484-5e69-86b4-2013c0099e18 with identifier: 121828
2026-04-22 13:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72380996-2484-5e69-86b4-2013c0099e18 with scrape type 1
2026-04-22 13:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 72380996-2484-5e69-86b4-2013c0099e18
2026-04-22 13:11:24 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 72380996-2484-5e69-86b4-2013c0099e18
2026-04-22 13:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 72380996-2484-5e69-86b4-2013c0099e18, identifier: 121828
2026-04-22 13:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:24 [manheim.gb] INFO: Found listing with ID: 1265479
2026-04-22 13:11:24 [manheim.gb] INFO: Scrape type for 1265479: 1
2026-04-22 13:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_4.jpg not downloaded yet
2026-04-22 13:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 72380996-2484-5e69-86b4-2013c0099e18 with identifier: 121828
2026-04-22 13:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Blue HTTP/1.1" 200 None
2026-04-22 13:11:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 72380996-2484-5e69-86b4-2013c0099e18 with identifier: 121828
2026-04-22 13:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 72380996-2484-5e69-86b4-2013c0099e18 with identifier: 121828 to the API
2026-04-22 13:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester - In Transit',
 'color': 'Blue',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '72380996-2484-5e69-86b4-2013c0099e18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'AU60PVX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=121828',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'longitude': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 142259,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2010-09-06',
 'seller_name': None,
 'title': 'FORD FOCUS 1.6 TDCi Zetec 5dr [110] [DPF]',
 'transmission': 'manual',
 'trim': '1.6 TDCi Zetec 5dr [110] [DPF]',
 'year': 2010}
2026-04-22 13:11:25 [manheim.gb] INFO: Saving data for 121828: {'created_time': 1776863485.078501, 'last_price_update_time': 1776863485.078513}
2026-04-22 13:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-002.jpg> (referer: None)
2026-04-22 13:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_7.jpg> (referer: None)
2026-04-22 13:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-010.jpg not downloaded yet
2026-04-22 13:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b076fe90>
2026-04-22 13:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-008.jpg saved to cache
2026-04-22 13:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8
2026-04-22 13:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faac0e0d-5212-57b4-ab3f-0f7895727be4 with identifier: 1227618
2026-04-22 13:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faac0e0d-5212-57b4-ab3f-0f7895727be4 with scrape type 1
2026-04-22 13:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item faac0e0d-5212-57b4-ab3f-0f7895727be4
2026-04-22 13:11:25 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item faac0e0d-5212-57b4-ab3f-0f7895727be4
2026-04-22 13:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: faac0e0d-5212-57b4-ab3f-0f7895727be4, identifier: 1227618
2026-04-22 13:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-003.jpg> (referer: None)
2026-04-22 13:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:25 [manheim.gb] INFO: Found listing with ID: 127065
2026-04-22 13:11:25 [manheim.gb] INFO: Scrape type for 127065: 0
2026-04-22 13:11:25 [manheim.gb] INFO: Found listing with ID: 1274051
2026-04-22 13:11:25 [manheim.gb] INFO: Scrape type for 1274051: 1
2026-04-22 13:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_11.jpg not downloaded yet
2026-04-22 13:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: faac0e0d-5212-57b4-ab3f-0f7895727be4 with identifier: 1227618
2026-04-22 13:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: faac0e0d-5212-57b4-ab3f-0f7895727be4 with identifier: 1227618
2026-04-22 13:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: faac0e0d-5212-57b4-ab3f-0f7895727be4 with identifier: 1227618 to the API
2026-04-22 13:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'Blue',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'faac0e0d-5212-57b4-ab3f-0f7895727be4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'GGZ6082',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/2%20SERIES?id=1227618',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'BMW',
 'model': '2 SERIES',
 'odometer': 141408,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-06-21',
 'seller_name': None,
 'title': 'BMW 2 SERIES 218d Luxury 5dr',
 'transmission': 'manual',
 'trim': '218d Luxury 5dr',
 'year': 2017}
2026-04-22 13:11:25 [manheim.gb] INFO: Saving data for 1227618: {'created_time': 1776863485.710418, 'last_price_update_time': 1776863485.710427}
2026-04-22 13:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_6.jpg> (referer: None)
2026-04-22 13:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_7.jpg> (referer: None)
2026-04-22 13:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-005.jpg> (referer: None)
2026-04-22 13:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b076dbd0>
2026-04-22 13:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-001.jpg saved to cache
2026-04-22 13:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8
2026-04-22 13:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7893da2-7f31-56b0-a978-fbb780ab8d3f with identifier: 123379
2026-04-22 13:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7893da2-7f31-56b0-a978-fbb780ab8d3f with scrape type 1
2026-04-22 13:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e7893da2-7f31-56b0-a978-fbb780ab8d3f
2026-04-22 13:11:25 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e7893da2-7f31-56b0-a978-fbb780ab8d3f
2026-04-22 13:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e7893da2-7f31-56b0-a978-fbb780ab8d3f, identifier: 123379
2026-04-22 13:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-006.jpg> (referer: None)
2026-04-22 13:11:26 [manheim.gb] INFO: Found listing with ID: 1276453
2026-04-22 13:11:26 [manheim.gb] INFO: Scrape type for 1276453: 0
2026-04-22 13:11:26 [manheim.gb] INFO: Found listing with ID: 1278516
2026-04-22 13:11:26 [manheim.gb] INFO: Scrape type for 1278516: 0
2026-04-22 13:11:26 [manheim.gb] INFO: Found listing with ID: 1280043
2026-04-22 13:11:26 [manheim.gb] INFO: Scrape type for 1280043: 1
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_10.jpg not downloaded yet
2026-04-22 13:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e7893da2-7f31-56b0-a978-fbb780ab8d3f with identifier: 123379
2026-04-22 13:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e7893da2-7f31-56b0-a978-fbb780ab8d3f with identifier: 123379
2026-04-22 13:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e7893da2-7f31-56b0-a978-fbb780ab8d3f with identifier: 123379 to the API
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.8L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'e7893da2-7f31-56b0-a978-fbb780ab8d3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'MW09NWD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/INSIGNIA?id=123379',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'INSIGNIA',
 'odometer': 177098,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2009-07-31',
 'seller_name': None,
 'title': 'VAUXHALL INSIGNIA 1.8i 16V Exclusiv 5dr',
 'transmission': 'manual',
 'trim': '1.8i 16V Exclusiv 5dr',
 'year': 2009}
2026-04-22 13:11:26 [manheim.gb] INFO: Saving data for 123379: {'created_time': 1776863486.452651, 'last_price_update_time': 1776863486.452665}
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0629b90>
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-002.jpg saved to cache
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1662e90>
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_7.jpg saved to cache
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5
2026-04-22 13:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_1.jpg> (referer: None)
2026-04-22 13:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1717210>
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-003.jpg saved to cache
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8
2026-04-22 13:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f177c5d-0f98-554e-89e2-d04f4b962a77 with identifier: 1241939
2026-04-22 13:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f177c5d-0f98-554e-89e2-d04f4b962a77 with scrape type 1
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f177c5d-0f98-554e-89e2-d04f4b962a77
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_7.jpg not downloaded yet
2026-04-22 13:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:26 [manheim.gb] INFO: Found listing with ID: 1282364
2026-04-22 13:11:26 [manheim.gb] INFO: Scrape type for 1282364: 1
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_9.jpg not downloaded yet
2026-04-22 13:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-009.jpg> (referer: None)
2026-04-22 13:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-007.jpg> (referer: None)
2026-04-22 13:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_5.jpg> (referer: None)
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_7.jpg not downloaded yet
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1676650>
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_6.jpg saved to cache
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1764dd0>
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_7.jpg saved to cache
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b15d6150>
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-005.jpg saved to cache
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1767890>
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-006.jpg saved to cache
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8
2026-04-22 13:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_4.jpg> (referer: None)
2026-04-22 13:11:26 [manheim.gb] INFO: Found listing with ID: 1291382
2026-04-22 13:11:26 [manheim.gb] INFO: Scrape type for 1291382: 1
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_2.jpg not downloaded yet
2026-04-22 13:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-010.jpg> (referer: None)
2026-04-22 13:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_6.jpg not downloaded yet
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b17544d0>
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_1.jpg saved to cache
2026-04-22 13:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5
2026-04-22 13:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f812f35-ba63-53f5-842c-df2d32aca413 with identifier: 1249271
2026-04-22 13:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f812f35-ba63-53f5-842c-df2d32aca413 with scrape type 1
2026-04-22 13:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6f812f35-ba63-53f5-842c-df2d32aca413
2026-04-22 13:11:27 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6f812f35-ba63-53f5-842c-df2d32aca413
2026-04-22 13:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6f812f35-ba63-53f5-842c-df2d32aca413, identifier: 1249271
2026-04-22 13:11:27 [manheim.gb] INFO: Found listing with ID: 1296503
2026-04-22 13:11:27 [manheim.gb] INFO: Scrape type for 1296503: 1
2026-04-22 13:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6f812f35-ba63-53f5-842c-df2d32aca413 with identifier: 1249271
2026-04-22 13:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6f812f35-ba63-53f5-842c-df2d32aca413 with identifier: 1249271
2026-04-22 13:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 6f812f35-ba63-53f5-842c-df2d32aca413 with identifier: 1249271 to the API
2026-04-22 13:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:27 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 6f812f35-ba63-53f5-842c-df2d32aca413: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:26 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:27 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:27 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '6f812f35-ba63-53f5-842c-df2d32aca413',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WK16LBN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/MOKKA?id=1249271',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'MOKKA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-04-20',
 'seller_name': None,
 'title': 'VAUXHALL MOKKA 1.4T Exclusiv 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.4T Exclusiv 5dr Auto',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:27 [manheim.gb] INFO: Saving data for 1249271: {'created_time': 1776863487.441498, 'last_price_update_time': 1776863487.441511}
2026-04-22 13:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a51c52c4-8caa-504b-8b78-6f2b61add8b2 with identifier: 1265479
2026-04-22 13:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a51c52c4-8caa-504b-8b78-6f2b61add8b2 with scrape type 1
2026-04-22 13:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a51c52c4-8caa-504b-8b78-6f2b61add8b2
2026-04-22 13:11:27 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a51c52c4-8caa-504b-8b78-6f2b61add8b2
2026-04-22 13:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a51c52c4-8caa-504b-8b78-6f2b61add8b2, identifier: 1265479
2026-04-22 13:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b075d4d0>
2026-04-22 13:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-009.jpg saved to cache
2026-04-22 13:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8
2026-04-22 13:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1675a10>
2026-04-22 13:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-007.jpg saved to cache
2026-04-22 13:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8
2026-04-22 13:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1632990>
2026-04-22 13:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_5.jpg saved to cache
2026-04-22 13:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5
2026-04-22 13:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_11.jpg> (referer: None)
2026-04-22 13:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_1.jpg not downloaded yet
2026-04-22 13:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a51c52c4-8caa-504b-8b78-6f2b61add8b2 with identifier: 1265479
2026-04-22 13:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a51c52c4-8caa-504b-8b78-6f2b61add8b2 with identifier: 1265479
2026-04-22 13:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a51c52c4-8caa-504b-8b78-6f2b61add8b2 with identifier: 1265479 to the API
2026-04-22 13:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:27 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id a51c52c4-8caa-504b-8b78-6f2b61add8b2: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:27 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:27 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:27 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'a51c52c4-8caa-504b-8b78-6f2b61add8b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'HV17WSZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1265479',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-28',
 'seller_name': None,
 'title': 'FORD FOCUS 1.0 EcoBoost 125 ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 ST-Line 5dr',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:27 [manheim.gb] INFO: Saving data for 1265479: {'created_time': 1776863487.997861, 'last_price_update_time': 1776863487.997875}
2026-04-22 13:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:28 [manheim.gb] INFO: Found listing with ID: 1303140
2026-04-22 13:11:28 [manheim.gb] INFO: Scrape type for 1303140: 0
2026-04-22 13:11:28 [manheim.gb] INFO: Found listing with ID: 1304652
2026-04-22 13:11:28 [manheim.gb] INFO: Scrape type for 1304652: 1
2026-04-22 13:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b076cbd0>
2026-04-22 13:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_4.jpg saved to cache
2026-04-22 13:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5
2026-04-22 13:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0783e50>
2026-04-22 13:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-010.jpg saved to cache
2026-04-22 13:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8
2026-04-22 13:11:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e37fdf8-51de-579c-91c6-98c9a4fd21a8, skipping ID generation
2026-04-22 13:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8 with scrape type 1
2026-04-22 13:11:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e37fdf8-51de-579c-91c6-98c9a4fd21a8 sending to next pipeline
2026-04-22 13:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6e37fdf8-51de-579c-91c6-98c9a4fd21a8, identifier: 1102904
2026-04-22 13:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d09ad6e-c9bc-5a99-a1e3-e0cc4d052cfd with identifier: 1274051
2026-04-22 13:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d09ad6e-c9bc-5a99-a1e3-e0cc4d052cfd with scrape type 1
2026-04-22 13:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2d09ad6e-c9bc-5a99-a1e3-e0cc4d052cfd
2026-04-22 13:11:28 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2d09ad6e-c9bc-5a99-a1e3-e0cc4d052cfd
2026-04-22 13:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2d09ad6e-c9bc-5a99-a1e3-e0cc4d052cfd, identifier: 1274051
2026-04-22 13:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_10.jpg> (referer: None)
2026-04-22 13:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_7.jpg> (referer: None)
2026-04-22 13:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_9.jpg> (referer: None)
2026-04-22 13:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_5.jpg not downloaded yet
2026-04-22 13:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6e37fdf8-51de-579c-91c6-98c9a4fd21a8 with identifier: 1102904
2026-04-22 13:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BEIGE HTTP/1.1" 200 None
2026-04-22 13:11:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6e37fdf8-51de-579c-91c6-98c9a4fd21a8 with identifier: 1102904
2026-04-22 13:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 6e37fdf8-51de-579c-91c6-98c9a4fd21a8 with identifier: 1102904 to the API
2026-04-22 13:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-010.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington',
 'color': 'BEIGE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '6e37fdf8-51de-579c-91c6-98c9a4fd21a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YY63WUP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/SUPERB?id=1102904',
 'listing': 'auction',
 'location': 'Washington',
 'longitude': None,
 'make': 'SKODA',
 'model': 'SUPERB',
 'odometer': 186330,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233190,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225196,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291231,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227810,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239806,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195829,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215119,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255122,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242773,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e37fdf8-51de-579c-91c6-98c9a4fd21a8/6e37fdf8-51de-579c-91c6-98c9a4fd21a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223956,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1102904-9999999-112084301-010.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-12-13',
 'seller_name': None,
 'title': 'SKODA SUPERB 1.6 TDI CR SE GreenLine III 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDI CR SE GreenLine III 5dr',
 'year': 2013}
2026-04-22 13:11:29 [manheim.gb] INFO: Saving data for 1102904: {'created_time': 1776863489.113239, 'last_price_update_time': 1776863489.11325}
2026-04-22 13:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2d09ad6e-c9bc-5a99-a1e3-e0cc4d052cfd with identifier: 1274051
2026-04-22 13:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2d09ad6e-c9bc-5a99-a1e3-e0cc4d052cfd with identifier: 1274051
2026-04-22 13:11:29 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 2d09ad6e-c9bc-5a99-a1e3-e0cc4d052cfd with identifier: 1274051 to the API
2026-04-22 13:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '2d09ad6e-c9bc-5a99-a1e3-e0cc4d052cfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'NJ61WJC',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1274051',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 115587,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2011-09-02',
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.5 dCi [110] N-Tec 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi [110] N-Tec 5dr',
 'year': 2011}
2026-04-22 13:11:29 [manheim.gb] INFO: Saving data for 1274051: {'created_time': 1776863489.484708, 'last_price_update_time': 1776863489.484719}
2026-04-22 13:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_7.jpg> (referer: None)
2026-04-22 13:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:29 [manheim.gb] INFO: Found listing with ID: 1305992
2026-04-22 13:11:29 [manheim.gb] INFO: Scrape type for 1305992: 0
2026-04-22 13:11:29 [manheim.gb] INFO: Found listing with ID: 1318037
2026-04-22 13:11:29 [manheim.gb] INFO: Scrape type for 1318037: 2
2026-04-22 13:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b15d46d0>
2026-04-22 13:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_11.jpg saved to cache
2026-04-22 13:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5
2026-04-22 13:11:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ce47af7-5c2a-55e0-aa0f-c81da4429dba with identifier: 1280043
2026-04-22 13:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ce47af7-5c2a-55e0-aa0f-c81da4429dba with scrape type 1
2026-04-22 13:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 9ce47af7-5c2a-55e0-aa0f-c81da4429dba
2026-04-22 13:11:29 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 9ce47af7-5c2a-55e0-aa0f-c81da4429dba
2026-04-22 13:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9ce47af7-5c2a-55e0-aa0f-c81da4429dba, identifier: 1280043
2026-04-22 13:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_4.jpg not downloaded yet
2026-04-22 13:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9ce47af7-5c2a-55e0-aa0f-c81da4429dba with identifier: 1280043
2026-04-22 13:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE+AND+BLACK HTTP/1.1" 200 None
2026-04-22 13:11:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9ce47af7-5c2a-55e0-aa0f-c81da4429dba with identifier: 1280043
2026-04-22 13:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9ce47af7-5c2a-55e0-aa0f-c81da4429dba with identifier: 1280043 to the API
2026-04-22 13:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:30 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 9ce47af7-5c2a-55e0-aa0f-c81da4429dba: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:29 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:30 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:30 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'WHITE AND BLACK',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '9ce47af7-5c2a-55e0-aa0f-c81da4429dba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WK63LKD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500L?id=1280043',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'FIAT',
 'model': '500L',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-09-30',
 'seller_name': None,
 'title': 'FIAT 500L 1.3 Multijet 85 Pop Star 5dr Dualogic',
 'transmission': 'automatic',
 'trim': '1.3 Multijet 85 Pop Star 5dr Dualogic',
 'year': 2013}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:30 [manheim.gb] INFO: Saving data for 1280043: {'created_time': 1776863490.269409, 'last_price_update_time': 1776863490.269421}
2026-04-22 13:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb058bc4-61af-5d31-9fba-b13f38cc3ab1 with identifier: 1282364
2026-04-22 13:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb058bc4-61af-5d31-9fba-b13f38cc3ab1 with scrape type 1
2026-04-22 13:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item cb058bc4-61af-5d31-9fba-b13f38cc3ab1
2026-04-22 13:11:30 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item cb058bc4-61af-5d31-9fba-b13f38cc3ab1
2026-04-22 13:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cb058bc4-61af-5d31-9fba-b13f38cc3ab1, identifier: 1282364
2026-04-22 13:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:30 [manheim.gb] INFO: Found listing with ID: 1319966
2026-04-22 13:11:30 [manheim.gb] INFO: Scrape type for 1319966: 1
2026-04-22 13:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cb058bc4-61af-5d31-9fba-b13f38cc3ab1 with identifier: 1282364
2026-04-22 13:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2026-04-22 13:11:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cb058bc4-61af-5d31-9fba-b13f38cc3ab1 with identifier: 1282364
2026-04-22 13:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cb058bc4-61af-5d31-9fba-b13f38cc3ab1 with identifier: 1282364 to the API
2026-04-22 13:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester - In Transit',
 'color': 'Silver',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'cb058bc4-61af-5d31-9fba-b13f38cc3ab1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'AK59FCF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=1282364',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 113060,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2009-09-21',
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 1.4 S 5dr',
 'transmission': 'manual',
 'trim': '1.4 S 5dr',
 'year': 2009}
2026-04-22 13:11:30 [manheim.gb] INFO: Saving data for 1282364: {'created_time': 1776863490.989716, 'last_price_update_time': 1776863490.989728}
2026-04-22 13:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_2.jpg> (referer: None)
2026-04-22 13:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_6.jpg> (referer: None)
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_11.jpg not downloaded yet
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b062a6d0>
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_10.jpg saved to cache
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14ccf50>
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_7.jpg saved to cache
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f177c5d-0f98-554e-89e2-d04f4b962a77
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14f3050>
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_9.jpg saved to cache
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b15d4490>
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_7.jpg saved to cache
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f177c5d-0f98-554e-89e2-d04f4b962a77
2026-04-22 13:11:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9a4f323-1daa-568e-9d1d-aecbf1e81010 with identifier: 1291382
2026-04-22 13:11:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9a4f323-1daa-568e-9d1d-aecbf1e81010 with scrape type 1
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9a4f323-1daa-568e-9d1d-aecbf1e81010
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_7.jpg not downloaded yet
2026-04-22 13:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_1.jpg> (referer: None)
2026-04-22 13:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:31 [manheim.gb] INFO: Found listing with ID: 1320457
2026-04-22 13:11:31 [manheim.gb] INFO: Scrape type for 1320457: 1
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_10.jpg not downloaded yet
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_7.jpg not downloaded yet
2026-04-22 13:11:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90f33b8e-d1e6-54d2-9803-9928c660ef7b with identifier: 1296503
2026-04-22 13:11:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f33b8e-d1e6-54d2-9803-9928c660ef7b with scrape type 1
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 90f33b8e-d1e6-54d2-9803-9928c660ef7b
2026-04-22 13:11:31 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 90f33b8e-d1e6-54d2-9803-9928c660ef7b
2026-04-22 13:11:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 90f33b8e-d1e6-54d2-9803-9928c660ef7b, identifier: 1296503
2026-04-22 13:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_5.jpg> (referer: None)
2026-04-22 13:11:31 [manheim.gb] INFO: Found listing with ID: 1322439
2026-04-22 13:11:32 [manheim.gb] INFO: Scrape type for 1322439: 0
2026-04-22 13:11:32 [manheim.gb] INFO: Found listing with ID: 1331422
2026-04-22 13:11:32 [manheim.gb] INFO: Scrape type for 1331422: 1
2026-04-22 13:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 90f33b8e-d1e6-54d2-9803-9928c660ef7b with identifier: 1296503
2026-04-22 13:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 90f33b8e-d1e6-54d2-9803-9928c660ef7b with identifier: 1296503
2026-04-22 13:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 90f33b8e-d1e6-54d2-9803-9928c660ef7b with identifier: 1296503 to the API
2026-04-22 13:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:32 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 90f33b8e-d1e6-54d2-9803-9928c660ef7b: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:32 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:32 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:32 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '90f33b8e-d1e6-54d2-9803-9928c660ef7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'SV61JMX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/COUNTRYMAN?id=1296503',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2012-01-20',
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 2.0 Cooper S D ALL4 5dr',
 'transmission': 'manual',
 'trim': '2.0 Cooper S D ALL4 5dr',
 'year': 2012}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:32 [manheim.gb] INFO: Saving data for 1296503: {'created_time': 1776863492.535368, 'last_price_update_time': 1776863492.535379}
2026-04-22 13:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1033ad0>
2026-04-22 13:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_2.jpg saved to cache
2026-04-22 13:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5
2026-04-22 13:11:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5, skipping ID generation
2026-04-22 13:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5 with scrape type 1
2026-04-22 13:11:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5 sending to next pipeline
2026-04-22 13:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5, identifier: 1124728
2026-04-22 13:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04be090>
2026-04-22 13:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_6.jpg saved to cache
2026-04-22 13:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f177c5d-0f98-554e-89e2-d04f4b962a77
2026-04-22 13:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_9.jpg not downloaded yet
2026-04-22 13:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_6.jpg not downloaded yet
2026-04-22 13:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5 with identifier: 1124728
2026-04-22 13:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5 with identifier: 1124728
2026-04-22 13:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5 with identifier: 1124728 to the API
2026-04-22 13:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'OE14PMX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=1124728',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': 112115,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230522,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230522,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272693,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228245,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190318,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177812,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191821,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171043,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187749,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5/28d94ab4-cd70-55c4-9b5e-88be3fd0f5a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291352,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e1057b4-74b9-42df-967c-162376fbb8b4_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'MERCEDES-BENZ A CLASS A200 [2.1] CDI AMG Sport 5dr',
 'transmission': 'manual',
 'trim': 'A200 [2.1] CDI AMG Sport 5dr',
 'year': 2014}
2026-04-22 13:11:33 [manheim.gb] INFO: Saving data for 1124728: {'created_time': 1776863493.173929, 'last_price_update_time': 1776863493.17394}
2026-04-22 13:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:33 [manheim.gb] INFO: Found listing with ID: 1333721
2026-04-22 13:11:33 [manheim.gb] INFO: Scrape type for 1333721: 1
2026-04-22 13:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_4.jpg> (referer: None)
2026-04-22 13:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_2.jpg not downloaded yet
2026-04-22 13:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_1.jpg not downloaded yet
2026-04-22 13:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b165bb90>
2026-04-22 13:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_1.jpg saved to cache
2026-04-22 13:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f177c5d-0f98-554e-89e2-d04f4b962a77
2026-04-22 13:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f33f3e7e-88a1-5878-b335-35018b73880c with identifier: 1304652
2026-04-22 13:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f33f3e7e-88a1-5878-b335-35018b73880c with scrape type 1
2026-04-22 13:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f33f3e7e-88a1-5878-b335-35018b73880c
2026-04-22 13:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-004.jpg not downloaded yet
2026-04-22 13:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0639ad0>
2026-04-22 13:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_5.jpg saved to cache
2026-04-22 13:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f177c5d-0f98-554e-89e2-d04f4b962a77
2026-04-22 13:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_7.jpg> (referer: None)
2026-04-22 13:11:33 [manheim.gb] INFO: Found listing with ID: 1341214
2026-04-22 13:11:33 [manheim.gb] INFO: Scrape type for 1341214: 0
2026-04-22 13:11:33 [manheim.gb] INFO: Found listing with ID: 1345808
2026-04-22 13:11:33 [manheim.gb] INFO: Scrape type for 1345808: 0
2026-04-22 13:11:33 [manheim.gb] INFO: Found listing with ID: 1362832
2026-04-22 13:11:33 [manheim.gb] INFO: Scrape type for 1362832: 1
2026-04-22 13:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_11.jpg> (referer: None)
2026-04-22 13:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_5.jpg not downloaded yet
2026-04-22 13:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-008.jpg not downloaded yet
2026-04-22 13:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70778e70-1ad7-536c-a8be-6783dee8ef10 with identifier: 1318037
2026-04-22 13:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70778e70-1ad7-536c-a8be-6783dee8ef10 with scrape type 2
2026-04-22 13:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70778e70-1ad7-536c-a8be-6783dee8ef10 with scrape type 2
2026-04-22 13:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 70778e70-1ad7-536c-a8be-6783dee8ef10, identifier: 1318037
2026-04-22 13:11:33 [manheim.gb] INFO: Found listing with ID: 1363958
2026-04-22 13:11:33 [manheim.gb] INFO: Scrape type for 1363958: 0
2026-04-22 13:11:33 [manheim.gb] INFO: Found listing with ID: 1369056
2026-04-22 13:11:33 [manheim.gb] INFO: Scrape type for 1369056: 1
2026-04-22 13:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 70778e70-1ad7-536c-a8be-6783dee8ef10 with identifier: 1318037
2026-04-22 13:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 70778e70-1ad7-536c-a8be-6783dee8ef10 with identifier: 1318037
2026-04-22 13:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 70778e70-1ad7-536c-a8be-6783dee8ef10 with identifier: 1318037 to the API
2026-04-22 13:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '70778e70-1ad7-536c-a8be-6783dee8ef10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'HF15VRG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=1318037',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 156404,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-03-07',
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 GDi 1 5dr',
 'transmission': 'manual',
 'trim': '1.6 GDi 1 5dr',
 'year': 2015}
2026-04-22 13:11:33 [manheim.gb] INFO: Saving data for 1318037: {'created_time': 1776247788.232519, 'last_price_update_time': 1776863493.923202}
2026-04-22 13:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0484f2ed-36fc-582d-9818-27b4340bd7d5 with identifier: 1319966
2026-04-22 13:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0484f2ed-36fc-582d-9818-27b4340bd7d5 with scrape type 1
2026-04-22 13:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0484f2ed-36fc-582d-9818-27b4340bd7d5
2026-04-22 13:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1319966-4168118-13.jpg not downloaded yet
2026-04-22 13:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0629a50>
2026-04-22 13:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_4.jpg saved to cache
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f177c5d-0f98-554e-89e2-d04f4b962a77
2026-04-22 13:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_10.jpg> (referer: None)
2026-04-22 13:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_4.jpg not downloaded yet
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-001.jpg not downloaded yet
2026-04-22 13:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_7.jpg> (referer: None)
2026-04-22 13:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:34 [manheim.gb] INFO: Found listing with ID: 136937
2026-04-22 13:11:34 [manheim.gb] INFO: Scrape type for 136937: 0
2026-04-22 13:11:34 [manheim.gb] INFO: Found listing with ID: 1374210
2026-04-22 13:11:34 [manheim.gb] INFO: Scrape type for 1374210: 1
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_7.jpg not downloaded yet
2026-04-22 13:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_9.jpg> (referer: None)
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_11.jpg not downloaded yet
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-002.jpg not downloaded yet
2026-04-22 13:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1087850>
2026-04-22 13:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_7.jpg saved to cache
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9a4f323-1daa-568e-9d1d-aecbf1e81010
2026-04-22 13:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b11917d0>
2026-04-22 13:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_11.jpg saved to cache
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f177c5d-0f98-554e-89e2-d04f4b962a77
2026-04-22 13:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f73a0f8-efee-5652-b40e-210dd25d7698 with identifier: 1320457
2026-04-22 13:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f73a0f8-efee-5652-b40e-210dd25d7698 with scrape type 1
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2f73a0f8-efee-5652-b40e-210dd25d7698
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2f73a0f8-efee-5652-b40e-210dd25d7698
2026-04-22 13:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2f73a0f8-efee-5652-b40e-210dd25d7698, identifier: 1320457
2026-04-22 13:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_6.jpg> (referer: None)
2026-04-22 13:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:34 [manheim.gb] INFO: Found listing with ID: 1374249
2026-04-22 13:11:34 [manheim.gb] INFO: Scrape type for 1374249: 0
2026-04-22 13:11:34 [manheim.gb] INFO: Found listing with ID: 1379331
2026-04-22 13:11:34 [manheim.gb] INFO: Scrape type for 1379331: 0
2026-04-22 13:11:34 [manheim.gb] INFO: Found listing with ID: 1391593
2026-04-22 13:11:34 [manheim.gb] INFO: Scrape type for 1391593: 0
2026-04-22 13:11:34 [manheim.gb] INFO: Found listing with ID: 1396950
2026-04-22 13:11:34 [manheim.gb] INFO: Scrape type for 1396950: 0
2026-04-22 13:11:34 [manheim.gb] INFO: Found listing with ID: 1405410
2026-04-22 13:11:34 [manheim.gb] INFO: Scrape type for 1405410: 0
2026-04-22 13:11:34 [manheim.gb] INFO: Found listing with ID: 1410060
2026-04-22 13:11:34 [manheim.gb] INFO: Scrape type for 1410060: 0
2026-04-22 13:11:34 [manheim.gb] INFO: Found listing with ID: 1412948
2026-04-22 13:11:34 [manheim.gb] INFO: Scrape type for 1412948: 1
2026-04-22 13:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_4.jpg not downloaded yet
2026-04-22 13:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2f73a0f8-efee-5652-b40e-210dd25d7698 with identifier: 1320457
2026-04-22 13:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2f73a0f8-efee-5652-b40e-210dd25d7698 with identifier: 1320457
2026-04-22 13:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 2f73a0f8-efee-5652-b40e-210dd25d7698 with identifier: 1320457 to the API
2026-04-22 13:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.7L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '2f73a0f8-efee-5652-b40e-210dd25d7698',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KW65FGK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/TUCSON?id=1320457',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 91685,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-12-23',
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.7 CRDi Blue Drive Premium 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.7 CRDi Blue Drive Premium 5dr 2WD',
 'year': 2015}
2026-04-22 13:11:34 [manheim.gb] INFO: Saving data for 1320457: {'created_time': 1776863494.868167, 'last_price_update_time': 1776863494.868179}
2026-04-22 13:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_1.jpg> (referer: None)
2026-04-22 13:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_2.jpg> (referer: None)
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_10.jpg not downloaded yet
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-003.jpg not downloaded yet
2026-04-22 13:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-004.jpg> (referer: None)
2026-04-22 13:11:35 [manheim.gb] INFO: Found listing with ID: 1422548
2026-04-22 13:11:35 [manheim.gb] INFO: Scrape type for 1422548: 1
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_3.jpg not downloaded yet
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b107cdd0>
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_10.jpg saved to cache
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f177c5d-0f98-554e-89e2-d04f4b962a77
2026-04-22 13:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 889fdb04-756d-5a65-b6ea-c6da43310493 with identifier: 1331422
2026-04-22 13:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 889fdb04-756d-5a65-b6ea-c6da43310493 with scrape type 1
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 889fdb04-756d-5a65-b6ea-c6da43310493
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 889fdb04-756d-5a65-b6ea-c6da43310493
2026-04-22 13:11:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 889fdb04-756d-5a65-b6ea-c6da43310493, identifier: 1331422
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0746690>
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_7.jpg saved to cache
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9a4f323-1daa-568e-9d1d-aecbf1e81010
2026-04-22 13:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac30550-f5c2-5524-ab37-486a1ea5672b with identifier: 1333721
2026-04-22 13:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac30550-f5c2-5524-ab37-486a1ea5672b with scrape type 1
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ac30550-f5c2-5524-ab37-486a1ea5672b
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1333721-4161303-13.jpg not downloaded yet
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05c55d0>
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_9.jpg saved to cache
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f177c5d-0f98-554e-89e2-d04f4b962a77
2026-04-22 13:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_5.jpg> (referer: None)
2026-04-22 13:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_9.jpg not downloaded yet
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-005.jpg not downloaded yet
2026-04-22 13:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 889fdb04-756d-5a65-b6ea-c6da43310493 with identifier: 1331422
2026-04-22 13:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 889fdb04-756d-5a65-b6ea-c6da43310493 with identifier: 1331422
2026-04-22 13:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 889fdb04-756d-5a65-b6ea-c6da43310493 with identifier: 1331422 to the API
2026-04-22 13:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:35 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 889fdb04-756d-5a65-b6ea-c6da43310493: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:35 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:35 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:35 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '889fdb04-756d-5a65-b6ea-c6da43310493',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'RF66HTY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/GL?id=1331422',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GL',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-11-29',
 'seller_name': None,
 'title': 'MERCEDES-BENZ GL GLE 250d 4Matic AMG Line Premium 5dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'GLE 250d 4Matic AMG Line Premium 5dr 9G-Tronic',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:35 [manheim.gb] INFO: Saving data for 1331422: {'created_time': 1776863495.767525, 'last_price_update_time': 1776863495.767539}
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04f1510>
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_6.jpg saved to cache
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9a4f323-1daa-568e-9d1d-aecbf1e81010
2026-04-22 13:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f499dd47-a52a-55c9-ba34-d284434b807d with identifier: 1362832
2026-04-22 13:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f499dd47-a52a-55c9-ba34-d284434b807d with scrape type 1
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f499dd47-a52a-55c9-ba34-d284434b807d
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f499dd47-a52a-55c9-ba34-d284434b807d
2026-04-22 13:11:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f499dd47-a52a-55c9-ba34-d284434b807d, identifier: 1362832
2026-04-22 13:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-008.jpg> (referer: None)
2026-04-22 13:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_4.jpg> (referer: None)
2026-04-22 13:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-001.jpg> (referer: None)
2026-04-22 13:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:35 [manheim.gb] INFO: Found listing with ID: 1423573
2026-04-22 13:11:35 [manheim.gb] INFO: Scrape type for 1423573: 1
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_5.jpg not downloaded yet
2026-04-22 13:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_7.jpg not downloaded yet
2026-04-22 13:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f499dd47-a52a-55c9-ba34-d284434b807d with identifier: 1362832
2026-04-22 13:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f499dd47-a52a-55c9-ba34-d284434b807d with identifier: 1362832
2026-04-22 13:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f499dd47-a52a-55c9-ba34-d284434b807d with identifier: 1362832 to the API
2026-04-22 13:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:36 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id f499dd47-a52a-55c9-ba34-d284434b807d: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:35 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:36 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:36 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'f499dd47-a52a-55c9-ba34-d284434b807d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YF63TNZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=1362832',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-11-30',
 'seller_name': None,
 'title': 'MERCEDES-BENZ A CLASS A180 CDI BlueEFFICIENCY Sport 5dr',
 'transmission': 'manual',
 'trim': 'A180 CDI BlueEFFICIENCY Sport 5dr',
 'year': 2013}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:36 [manheim.gb] INFO: Saving data for 1362832: {'created_time': 1776863496.31142, 'last_price_update_time': 1776863496.311434}
2026-04-22 13:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b075b5d0>
2026-04-22 13:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_1.jpg saved to cache
2026-04-22 13:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9a4f323-1daa-568e-9d1d-aecbf1e81010
2026-04-22 13:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b18800d0>
2026-04-22 13:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_2.jpg saved to cache
2026-04-22 13:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f177c5d-0f98-554e-89e2-d04f4b962a77
2026-04-22 13:11:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f177c5d-0f98-554e-89e2-d04f4b962a77, skipping ID generation
2026-04-22 13:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f177c5d-0f98-554e-89e2-d04f4b962a77 with scrape type 1
2026-04-22 13:11:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f177c5d-0f98-554e-89e2-d04f4b962a77 sending to next pipeline
2026-04-22 13:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5f177c5d-0f98-554e-89e2-d04f4b962a77, identifier: 1241939
2026-04-22 13:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_2.jpg not downloaded yet
2026-04-22 13:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-006.jpg not downloaded yet
2026-04-22 13:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5f177c5d-0f98-554e-89e2-d04f4b962a77 with identifier: 1241939
2026-04-22 13:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Red HTTP/1.1" 200 None
2026-04-22 13:11:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5f177c5d-0f98-554e-89e2-d04f4b962a77 with identifier: 1241939
2026-04-22 13:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5f177c5d-0f98-554e-89e2-d04f4b962a77 with identifier: 1241939 to the API
2026-04-22 13:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'Red',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '5f177c5d-0f98-554e-89e2-d04f4b962a77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'PO11UML',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A1?id=1241939',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'AUDI',
 'model': 'A1',
 'odometer': 107342,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176865,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176865,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260567,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190833,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184157,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159406,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206095,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189078,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169070,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f177c5d-0f98-554e-89e2-d04f4b962a77/5f177c5d-0f98-554e-89e2-d04f4b962a77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252960,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c38d8244-7550-48ba-af26-543da9cabae5_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2011-05-31',
 'seller_name': None,
 'title': 'AUDI A1 1.6 TDI Sport Hatchback 3dr Diesel Manual Euro 5 (',
 'transmission': 'manual',
 'trim': '1.6 TDI Sport Hatchback 3dr Diesel Manual Euro 5 (',
 'year': 2011}
2026-04-22 13:11:37 [manheim.gb] INFO: Saving data for 1241939: {'created_time': 1776863497.163209, 'last_price_update_time': 1776863497.163224}
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b060de90>
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-004.jpg saved to cache
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f33f3e7e-88a1-5878-b335-35018b73880c
2026-04-22 13:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:37 [manheim.gb] INFO: Found listing with ID: 1428476
2026-04-22 13:11:37 [manheim.gb] INFO: Scrape type for 1428476: 1
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_2.jpg not downloaded yet
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_4.jpg not downloaded yet
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b069a310>
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_5.jpg saved to cache
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9a4f323-1daa-568e-9d1d-aecbf1e81010
2026-04-22 13:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ee4111-4d4e-5eff-8a8f-903b931caac6 with identifier: 1369056
2026-04-22 13:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ee4111-4d4e-5eff-8a8f-903b931caac6 with scrape type 1
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62ee4111-4d4e-5eff-8a8f-903b931caac6
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1369056-4164887-13.jpg not downloaded yet
2026-04-22 13:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_7.jpg> (referer: None)
2026-04-22 13:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-002.jpg> (referer: None)
2026-04-22 13:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_11.jpg> (referer: None)
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1304652-4058705-13.jpg not downloaded yet
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05e0250>
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-008.jpg saved to cache
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f33f3e7e-88a1-5878-b335-35018b73880c
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04d98d0>
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_4.jpg saved to cache
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9a4f323-1daa-568e-9d1d-aecbf1e81010
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0700150>
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-001.jpg saved to cache
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f33f3e7e-88a1-5878-b335-35018b73880c
2026-04-22 13:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 995fc0bd-11bc-58ed-b85d-de408fcd6299 with identifier: 1374210
2026-04-22 13:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 995fc0bd-11bc-58ed-b85d-de408fcd6299 with scrape type 1
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 995fc0bd-11bc-58ed-b85d-de408fcd6299
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 995fc0bd-11bc-58ed-b85d-de408fcd6299
2026-04-22 13:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 995fc0bd-11bc-58ed-b85d-de408fcd6299, identifier: 1374210
2026-04-22 13:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1319966-4168118-13.jpg> (referer: None)
2026-04-22 13:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_4.jpg> (referer: None)
2026-04-22 13:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:37 [manheim.gb] INFO: Found listing with ID: 1440099
2026-04-22 13:11:37 [manheim.gb] INFO: Scrape type for 1440099: 1
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_9.jpg not downloaded yet
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_3.jpg not downloaded yet
2026-04-22 13:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_7.jpg not downloaded yet
2026-04-22 13:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 995fc0bd-11bc-58ed-b85d-de408fcd6299 with identifier: 1374210
2026-04-22 13:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 995fc0bd-11bc-58ed-b85d-de408fcd6299 with identifier: 1374210
2026-04-22 13:11:37 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 995fc0bd-11bc-58ed-b85d-de408fcd6299 with identifier: 1374210 to the API
2026-04-22 13:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:38 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 995fc0bd-11bc-58ed-b85d-de408fcd6299: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:37 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:38 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:38 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '995fc0bd-11bc-58ed-b85d-de408fcd6299',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'PF65YWR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C1?id=1374210',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'CITROEN',
 'model': 'C1',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-01-09',
 'seller_name': None,
 'title': 'CITROEN C1 1.2 PureTech Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Flair 5dr',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:38 [manheim.gb] INFO: Saving data for 1374210: {'created_time': 1776863498.032113, 'last_price_update_time': 1776863498.032124}
2026-04-22 13:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_10.jpg> (referer: None)
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-012.jpg not downloaded yet
2026-04-22 13:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e09d321e-35a6-5ab7-b5a1-e17733a461df with identifier: 1412948
2026-04-22 13:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e09d321e-35a6-5ab7-b5a1-e17733a461df with scrape type 1
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e09d321e-35a6-5ab7-b5a1-e17733a461df
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e09d321e-35a6-5ab7-b5a1-e17733a461df
2026-04-22 13:11:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e09d321e-35a6-5ab7-b5a1-e17733a461df, identifier: 1412948
2026-04-22 13:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1333721-4161303-13.jpg> (referer: None)
2026-04-22 13:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:38 [manheim.gb] INFO: Found listing with ID: 1440826
2026-04-22 13:11:38 [manheim.gb] INFO: Scrape type for 1440826: 0
2026-04-22 13:11:38 [manheim.gb] INFO: Found listing with ID: 1442217
2026-04-22 13:11:38 [manheim.gb] INFO: Scrape type for 1442217: 1
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_10.jpg not downloaded yet
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_5.jpg not downloaded yet
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_4.jpg not downloaded yet
2026-04-22 13:11:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e09d321e-35a6-5ab7-b5a1-e17733a461df with identifier: 1412948
2026-04-22 13:11:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e09d321e-35a6-5ab7-b5a1-e17733a461df with identifier: 1412948
2026-04-22 13:11:38 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e09d321e-35a6-5ab7-b5a1-e17733a461df with identifier: 1412948 to the API
2026-04-22 13:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:38 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id e09d321e-35a6-5ab7-b5a1-e17733a461df: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:38 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:38 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:38 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'e09d321e-35a6-5ab7-b5a1-e17733a461df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'LD17BTX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=1412948',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'CITROEN',
 'model': 'C3',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-31',
 'seller_name': None,
 'title': 'CITROEN C3 1.2 PureTech 82 Feel 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 82 Feel 5dr',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:38 [manheim.gb] INFO: Saving data for 1412948: {'created_time': 1776863498.635999, 'last_price_update_time': 1776863498.636011}
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06fe690>
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_7.jpg saved to cache
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0484f2ed-36fc-582d-9818-27b4340bd7d5
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04b26d0>
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-002.jpg saved to cache
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f33f3e7e-88a1-5878-b335-35018b73880c
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b175ef90>
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_11.jpg saved to cache
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9a4f323-1daa-568e-9d1d-aecbf1e81010
2026-04-22 13:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-003.jpg> (referer: None)
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-011.jpg not downloaded yet
2026-04-22 13:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_9.jpg> (referer: None)
2026-04-22 13:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:38 [manheim.gb] INFO: Found listing with ID: 1443203
2026-04-22 13:11:38 [manheim.gb] INFO: Scrape type for 1443203: 1
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_11.jpg not downloaded yet
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_2.jpg not downloaded yet
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_3.jpg not downloaded yet
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b186fa50>
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1319966-4168118-13.jpg saved to cache
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0484f2ed-36fc-582d-9818-27b4340bd7d5
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0740610>
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_4.jpg saved to cache
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0484f2ed-36fc-582d-9818-27b4340bd7d5
2026-04-22 13:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40cdd577-4550-56f8-b9f0-2040044bfd3d with identifier: 1422548
2026-04-22 13:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40cdd577-4550-56f8-b9f0-2040044bfd3d with scrape type 1
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 40cdd577-4550-56f8-b9f0-2040044bfd3d
2026-04-22 13:11:38 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 40cdd577-4550-56f8-b9f0-2040044bfd3d
2026-04-22 13:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 40cdd577-4550-56f8-b9f0-2040044bfd3d, identifier: 1422548
2026-04-22 13:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16cb790>
2026-04-22 13:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_10.jpg saved to cache
2026-04-22 13:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9a4f323-1daa-568e-9d1d-aecbf1e81010
2026-04-22 13:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-005.jpg> (referer: None)
2026-04-22 13:11:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 40cdd577-4550-56f8-b9f0-2040044bfd3d with identifier: 1422548
2026-04-22 13:11:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 40cdd577-4550-56f8-b9f0-2040044bfd3d with identifier: 1422548
2026-04-22 13:11:39 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 40cdd577-4550-56f8-b9f0-2040044bfd3d with identifier: 1422548 to the API
2026-04-22 13:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:39 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 40cdd577-4550-56f8-b9f0-2040044bfd3d: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:38 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:39 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:39 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '40cdd577-4550-56f8-b9f0-2040044bfd3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'LL65RNZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/3%20SERIES?id=1422548',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'BMW',
 'model': '3 SERIES',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-11-17',
 'seller_name': None,
 'title': 'BMW 3 SERIES 330d Luxury 5dr Step Auto [Business Media]',
 'transmission': 'automatic',
 'trim': '330d Luxury 5dr Step Auto [Business Media]',
 'year': 2015}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:39 [manheim.gb] INFO: Saving data for 1422548: {'created_time': 1776863499.410082, 'last_price_update_time': 1776863499.410094}
2026-04-22 13:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_3.jpg> (referer: None)
2026-04-22 13:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_7.jpg> (referer: None)
2026-04-22 13:11:39 [manheim.gb] INFO: Found listing with ID: 1444956
2026-04-22 13:11:39 [manheim.gb] INFO: Scrape type for 1444956: 1
2026-04-22 13:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_4.jpg not downloaded yet
2026-04-22 13:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_9.jpg not downloaded yet
2026-04-22 13:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_5.jpg not downloaded yet
2026-04-22 13:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06a7f90>
2026-04-22 13:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1333721-4161303-13.jpg saved to cache
2026-04-22 13:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ac30550-f5c2-5524-ab37-486a1ea5672b
2026-04-22 13:11:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e02d296e-51bc-5deb-bda8-8a07c2e7fc51 with identifier: 1423573
2026-04-22 13:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e02d296e-51bc-5deb-bda8-8a07c2e7fc51 with scrape type 1
2026-04-22 13:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e02d296e-51bc-5deb-bda8-8a07c2e7fc51
2026-04-22 13:11:39 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e02d296e-51bc-5deb-bda8-8a07c2e7fc51
2026-04-22 13:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e02d296e-51bc-5deb-bda8-8a07c2e7fc51, identifier: 1423573
2026-04-22 13:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_5.jpg> (referer: None)
2026-04-22 13:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-006.jpg> (referer: None)
2026-04-22 13:11:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e02d296e-51bc-5deb-bda8-8a07c2e7fc51 with identifier: 1423573
2026-04-22 13:11:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e02d296e-51bc-5deb-bda8-8a07c2e7fc51 with identifier: 1423573
2026-04-22 13:11:39 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e02d296e-51bc-5deb-bda8-8a07c2e7fc51 with identifier: 1423573 to the API
2026-04-22 13:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:39 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id e02d296e-51bc-5deb-bda8-8a07c2e7fc51: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:39 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:39 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:39 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'e02d296e-51bc-5deb-bda8-8a07c2e7fc51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'OY16YRW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY%20SPORT?id=1423573',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-03-29',
 'seller_name': None,
 'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 SE Tech 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 180 SE Tech 5dr Auto',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:40 [manheim.gb] INFO: Saving data for 1423573: {'created_time': 1776863500.014655, 'last_price_update_time': 1776863500.014666}
2026-04-22 13:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06e0550>
2026-04-22 13:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-003.jpg saved to cache
2026-04-22 13:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f33f3e7e-88a1-5878-b335-35018b73880c
2026-04-22 13:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04cdf50>
2026-04-22 13:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_9.jpg saved to cache
2026-04-22 13:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9a4f323-1daa-568e-9d1d-aecbf1e81010
2026-04-22 13:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5a50485-32ef-5e1e-8b5e-620200fcd860 with identifier: 1428476
2026-04-22 13:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5a50485-32ef-5e1e-8b5e-620200fcd860 with scrape type 1
2026-04-22 13:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f5a50485-32ef-5e1e-8b5e-620200fcd860
2026-04-22 13:11:40 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f5a50485-32ef-5e1e-8b5e-620200fcd860
2026-04-22 13:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f5a50485-32ef-5e1e-8b5e-620200fcd860, identifier: 1428476
2026-04-22 13:11:40 [manheim.gb] INFO: Found listing with ID: 1446525
2026-04-22 13:11:40 [manheim.gb] INFO: Scrape type for 1446525: 0
2026-04-22 13:11:40 [manheim.gb] INFO: Found listing with ID: 1448659
2026-04-22 13:11:40 [manheim.gb] INFO: Scrape type for 1448659: 0
2026-04-22 13:11:40 [manheim.gb] INFO: Found listing with ID: 1452227
2026-04-22 13:11:40 [manheim.gb] INFO: Scrape type for 1452227: 0
2026-04-22 13:11:40 [manheim.gb] INFO: Found listing with ID: 1454422
2026-04-22 13:11:40 [manheim.gb] INFO: Scrape type for 1454422: 0
2026-04-22 13:11:40 [manheim.gb] INFO: Found listing with ID: 1459655
2026-04-22 13:11:40 [manheim.gb] INFO: Scrape type for 1459655: 1
2026-04-22 13:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_10.jpg not downloaded yet
2026-04-22 13:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_2.jpg not downloaded yet
2026-04-22 13:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f5a50485-32ef-5e1e-8b5e-620200fcd860 with identifier: 1428476
2026-04-22 13:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f5a50485-32ef-5e1e-8b5e-620200fcd860 with identifier: 1428476
2026-04-22 13:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f5a50485-32ef-5e1e-8b5e-620200fcd860 with identifier: 1428476 to the API
2026-04-22 13:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'f5a50485-32ef-5e1e-8b5e-620200fcd860',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KN67NHA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/308?id=1428476',
 'listing': 'auction',
 'location': 'Washington',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 52778,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'PEUGEOT 308 1.6 BlueHDi 120 GT Line 5dr',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi 120 GT Line 5dr',
 'year': 2017}
2026-04-22 13:11:42 [manheim.gb] INFO: Saving data for 1428476: {'created_time': 1776863502.15084, 'last_price_update_time': 1776863502.150854}
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04de110>
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-005.jpg saved to cache
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f33f3e7e-88a1-5878-b335-35018b73880c
2026-04-22 13:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_2.jpg> (referer: None)
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b174b850>
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_3.jpg saved to cache
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0484f2ed-36fc-582d-9818-27b4340bd7d5
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0575450>
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_7.jpg saved to cache
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ac30550-f5c2-5524-ab37-486a1ea5672b
2026-04-22 13:11:42 [manheim.gb] INFO: Found listing with ID: 1474965
2026-04-22 13:11:42 [manheim.gb] INFO: Scrape type for 1474965: 1
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_11.jpg not downloaded yet
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_9.jpg not downloaded yet
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06dbfd0>
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_5.jpg saved to cache
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0484f2ed-36fc-582d-9818-27b4340bd7d5
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b052f350>
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-006.jpg saved to cache
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f33f3e7e-88a1-5878-b335-35018b73880c
2026-04-22 13:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1369056-4164887-13.jpg> (referer: None)
2026-04-22 13:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_4.jpg> (referer: None)
2026-04-22 13:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_2.jpg> (referer: None)
2026-04-22 13:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_7.jpg> (referer: None)
2026-04-22 13:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_9.jpg> (referer: None)
2026-04-22 13:11:42 [manheim.gb] INFO: Found listing with ID: 1480334
2026-04-22 13:11:42 [manheim.gb] INFO: Scrape type for 1480334: 0
2026-04-22 13:11:42 [manheim.gb] INFO: Found listing with ID: 1481781
2026-04-22 13:11:42 [manheim.gb] INFO: Scrape type for 1481781: 1
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_4.jpg not downloaded yet
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_10.jpg not downloaded yet
2026-04-22 13:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1304652-4058705-13.jpg> (referer: None)
2026-04-22 13:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_3.jpg> (referer: None)
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0539a50>
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_2.jpg saved to cache
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9a4f323-1daa-568e-9d1d-aecbf1e81010
2026-04-22 13:11:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9a4f323-1daa-568e-9d1d-aecbf1e81010, skipping ID generation
2026-04-22 13:11:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9a4f323-1daa-568e-9d1d-aecbf1e81010 with scrape type 1
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9a4f323-1daa-568e-9d1d-aecbf1e81010 sending to next pipeline
2026-04-22 13:11:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f9a4f323-1daa-568e-9d1d-aecbf1e81010, identifier: 1291382
2026-04-22 13:11:42 [manheim.gb] INFO: Found listing with ID: 1488398
2026-04-22 13:11:42 [manheim.gb] INFO: Scrape type for 1488398: 0
2026-04-22 13:11:42 [manheim.gb] INFO: Found listing with ID: 149162
2026-04-22 13:11:42 [manheim.gb] INFO: Scrape type for 149162: 2
2026-04-22 13:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_11.jpg not downloaded yet
2026-04-22 13:11:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f9a4f323-1daa-568e-9d1d-aecbf1e81010 with identifier: 1291382
2026-04-22 13:11:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f9a4f323-1daa-568e-9d1d-aecbf1e81010 with identifier: 1291382
2026-04-22 13:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f9a4f323-1daa-568e-9d1d-aecbf1e81010 with identifier: 1291382 to the API
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'f9a4f323-1daa-568e-9d1d-aecbf1e81010',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'FN65WNA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/KUGA?id=1291382',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 117937,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192834,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192834,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239812,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209954,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183633,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166639,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187162,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172012,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187471,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9a4f323-1daa-568e-9d1d-aecbf1e81010/f9a4f323-1daa-568e-9d1d-aecbf1e81010_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248972,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/68fcc70f-792f-41ff-9bf8-794dab7b590d_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'FORD KUGA 2.0 TDCi 180 Titanium X Sport 5dr Powershift',
 'transmission': 'automatic',
 'trim': '2.0 TDCi 180 Titanium X Sport 5dr Powershift',
 'year': 2015}
2026-04-22 13:11:43 [manheim.gb] INFO: Saving data for 1291382: {'created_time': 1776863503.294368, 'last_price_update_time': 1776863503.294378}
2026-04-22 13:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_4.jpg> (referer: None)
2026-04-22 13:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:43 [manheim.gb] INFO: Found listing with ID: 1491957
2026-04-22 13:11:43 [manheim.gb] INFO: Scrape type for 1491957: 0
2026-04-22 13:11:43 [manheim.gb] INFO: Found listing with ID: 1496148
2026-04-22 13:11:43 [manheim.gb] INFO: Scrape type for 1496148: 1
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_4.jpg not downloaded yet
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05746d0>
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1369056-4164887-13.jpg saved to cache
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62ee4111-4d4e-5eff-8a8f-903b931caac6
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b072e0d0>
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_4.jpg saved to cache
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ac30550-f5c2-5524-ab37-486a1ea5672b
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0572090>
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_2.jpg saved to cache
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0484f2ed-36fc-582d-9818-27b4340bd7d5
2026-04-22 13:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ba64d59-5d38-5054-831f-7cea1dc3b80c with identifier: 1443203
2026-04-22 13:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ba64d59-5d38-5054-831f-7cea1dc3b80c with scrape type 1
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3ba64d59-5d38-5054-831f-7cea1dc3b80c
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3ba64d59-5d38-5054-831f-7cea1dc3b80c
2026-04-22 13:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3ba64d59-5d38-5054-831f-7cea1dc3b80c, identifier: 1443203
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b053a210>
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_7.jpg saved to cache
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 62ee4111-4d4e-5eff-8a8f-903b931caac6
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06f1650>
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_9.jpg saved to cache
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0484f2ed-36fc-582d-9818-27b4340bd7d5
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b165a5d0>
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1304652-4058705-13.jpg saved to cache
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f33f3e7e-88a1-5878-b335-35018b73880c
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06e3510>
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_3.jpg saved to cache
2026-04-22 13:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ac30550-f5c2-5524-ab37-486a1ea5672b
2026-04-22 13:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_10.jpg> (referer: None)
2026-04-22 13:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3ba64d59-5d38-5054-831f-7cea1dc3b80c with identifier: 1443203
2026-04-22 13:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3ba64d59-5d38-5054-831f-7cea1dc3b80c with identifier: 1443203
2026-04-22 13:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 3ba64d59-5d38-5054-831f-7cea1dc3b80c with identifier: 1443203 to the API
2026-04-22 13:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '3ba64d59-5d38-5054-831f-7cea1dc3b80c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KM17UEL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=1443203',
 'listing': 'auction',
 'location': 'Manchester',
 'longitude': None,
 'make': 'CITROEN',
 'model': 'C3',
 'odometer': 111331,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-29',
 'seller_name': None,
 'title': 'CITROEN C3 1.2 PureTech 110 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 110 Flair 5dr',
 'year': 2017}
2026-04-22 13:11:44 [manheim.gb] INFO: Saving data for 1443203: {'created_time': 1776863504.168299, 'last_price_update_time': 1776863504.16831}
2026-04-22 13:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-011.jpg> (referer: None)
2026-04-22 13:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_11.jpg> (referer: None)
2026-04-22 13:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:44 [manheim.gb] INFO: Found listing with ID: 1497264
2026-04-22 13:11:44 [manheim.gb] INFO: Scrape type for 1497264: 0
2026-04-22 13:11:44 [manheim.gb] INFO: Found listing with ID: 1498745
2026-04-22 13:11:44 [manheim.gb] INFO: Scrape type for 1498745: 0
2026-04-22 13:11:44 [manheim.gb] INFO: Found listing with ID: 1504431
2026-04-22 13:11:44 [manheim.gb] INFO: Scrape type for 1504431: 1
2026-04-22 13:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_3.jpg> (referer: None)
2026-04-22 13:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b071ba50>
2026-04-22 13:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_4.jpg saved to cache
2026-04-22 13:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 62ee4111-4d4e-5eff-8a8f-903b931caac6
2026-04-22 13:11:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 446682e5-84df-524e-bce8-4c65c4ed9d1a with identifier: 1459655
2026-04-22 13:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446682e5-84df-524e-bce8-4c65c4ed9d1a with scrape type 1
2026-04-22 13:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 446682e5-84df-524e-bce8-4c65c4ed9d1a
2026-04-22 13:11:44 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 446682e5-84df-524e-bce8-4c65c4ed9d1a
2026-04-22 13:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 446682e5-84df-524e-bce8-4c65c4ed9d1a, identifier: 1459655
2026-04-22 13:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_5.jpg> (referer: None)
2026-04-22 13:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_2.jpg> (referer: None)
2026-04-22 13:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_5.jpg> (referer: None)
2026-04-22 13:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 446682e5-84df-524e-bce8-4c65c4ed9d1a with identifier: 1459655
2026-04-22 13:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 446682e5-84df-524e-bce8-4c65c4ed9d1a with identifier: 1459655
2026-04-22 13:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 446682e5-84df-524e-bce8-4c65c4ed9d1a with identifier: 1459655 to the API
2026-04-22 13:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.1L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '446682e5-84df-524e-bce8-4c65c4ed9d1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'FG67WNW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/C%20CLASS?id=1459655',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS',
 'odometer': 112074,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-09-30',
 'seller_name': None,
 'title': 'MERCEDES-BENZ C CLASS C220d AMG Line 4dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'C220d AMG Line 4dr 9G-Tronic',
 'year': 2017}
2026-04-22 13:11:44 [manheim.gb] INFO: Saving data for 1459655: {'created_time': 1776863504.91667, 'last_price_update_time': 1776863504.916682}
2026-04-22 13:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1691a50>
2026-04-22 13:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_10.jpg saved to cache
2026-04-22 13:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0484f2ed-36fc-582d-9818-27b4340bd7d5
2026-04-22 13:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_2.jpg> (referer: None)
2026-04-22 13:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b063ae90>
2026-04-22 13:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-011.jpg saved to cache
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f33f3e7e-88a1-5878-b335-35018b73880c
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05547d0>
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_11.jpg saved to cache
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0484f2ed-36fc-582d-9818-27b4340bd7d5
2026-04-22 13:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 378a3805-7000-5b3e-ac20-6d18029b836a with identifier: 1474965
2026-04-22 13:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 378a3805-7000-5b3e-ac20-6d18029b836a with scrape type 1
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 378a3805-7000-5b3e-ac20-6d18029b836a
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_3.jpg not downloaded yet
2026-04-22 13:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_10.jpg> (referer: None)
2026-04-22 13:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b07542d0>
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_3.jpg saved to cache
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 62ee4111-4d4e-5eff-8a8f-903b931caac6
2026-04-22 13:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_9.jpg> (referer: None)
2026-04-22 13:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_7.jpg not downloaded yet
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0516710>
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_5.jpg saved to cache
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ac30550-f5c2-5524-ab37-486a1ea5672b
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1754810>
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_2.jpg saved to cache
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ac30550-f5c2-5524-ab37-486a1ea5672b
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0498210>
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_5.jpg saved to cache
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 62ee4111-4d4e-5eff-8a8f-903b931caac6
2026-04-22 13:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d296273-d95d-598c-b43d-26fbec04ecd1 with identifier: 149162
2026-04-22 13:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d296273-d95d-598c-b43d-26fbec04ecd1 with scrape type 2
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d296273-d95d-598c-b43d-26fbec04ecd1 with scrape type 2
2026-04-22 13:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9d296273-d95d-598c-b43d-26fbec04ecd1, identifier: 149162
2026-04-22 13:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_9.jpg> (referer: None)
2026-04-22 13:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_11.jpg> (referer: None)
2026-04-22 13:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9d296273-d95d-598c-b43d-26fbec04ecd1 with identifier: 149162
2026-04-22 13:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9d296273-d95d-598c-b43d-26fbec04ecd1 with identifier: 149162
2026-04-22 13:11:45 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9d296273-d95d-598c-b43d-26fbec04ecd1 with identifier: 149162 to the API
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:45 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 9d296273-d95d-598c-b43d-26fbec04ecd1: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:45 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:45 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:45 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.9L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '9d296273-d95d-598c-b43d-26fbec04ecd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'LM10RYA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/TOURAN?id=149162',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2010-05-12',
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN 1.9 TDI Match 5dr',
 'transmission': 'manual',
 'trim': '1.9 TDI Match 5dr',
 'year': 2010}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:45 [manheim.gb] INFO: Saving data for 149162: {'created_time': 1776247780.460488, 'last_price_update_time': 1776863505.788462}
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04c5010>
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_2.jpg saved to cache
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 62ee4111-4d4e-5eff-8a8f-903b931caac6
2026-04-22 13:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_4.jpg not downloaded yet
2026-04-22 13:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_10.jpg> (referer: None)
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1679710>
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_10.jpg saved to cache
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ac30550-f5c2-5524-ab37-486a1ea5672b
2026-04-22 13:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df042765-1077-5cdf-980e-7e98c023b162 with identifier: 1496148
2026-04-22 13:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df042765-1077-5cdf-980e-7e98c023b162 with scrape type 1
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item df042765-1077-5cdf-980e-7e98c023b162
2026-04-22 13:11:45 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item df042765-1077-5cdf-980e-7e98c023b162
2026-04-22 13:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: df042765-1077-5cdf-980e-7e98c023b162, identifier: 1496148
2026-04-22 13:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2eb1cd0>
2026-04-22 13:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_9.jpg saved to cache
2026-04-22 13:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ac30550-f5c2-5524-ab37-486a1ea5672b
2026-04-22 13:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7fa44ef-0d84-53b1-a743-f913b906492f with identifier: 1481781
2026-04-22 13:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7fa44ef-0d84-53b1-a743-f913b906492f with scrape type 1
2026-04-22 13:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f7fa44ef-0d84-53b1-a743-f913b906492f
2026-04-22 13:11:46 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f7fa44ef-0d84-53b1-a743-f913b906492f
2026-04-22 13:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f7fa44ef-0d84-53b1-a743-f913b906492f, identifier: 1481781
2026-04-22 13:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_11.jpg> (referer: None)
2026-04-22 13:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_4.jpg> (referer: None)
2026-04-22 13:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_4.jpg> (referer: None)
2026-04-22 13:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_4.jpg> (referer: None)
2026-04-22 13:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1474965-4167108-13.jpg not downloaded yet
2026-04-22 13:11:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: df042765-1077-5cdf-980e-7e98c023b162 with identifier: 1496148
2026-04-22 13:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey HTTP/1.1" 200 None
2026-04-22 13:11:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: df042765-1077-5cdf-980e-7e98c023b162 with identifier: 1496148
2026-04-22 13:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: df042765-1077-5cdf-980e-7e98c023b162 with identifier: 1496148 to the API
2026-04-22 13:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham',
 'color': 'Grey',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'df042765-1077-5cdf-980e-7e98c023b162',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BD17HEU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=1496148',
 'listing': 'auction',
 'location': 'Birmingham',
 'longitude': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 70833,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-29',
 'seller_name': None,
 'title': 'FORD FIESTA 1.0 EcoBoost ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost ST-Line 5dr',
 'year': 2017}
2026-04-22 13:11:46 [manheim.gb] INFO: Saving data for 1496148: {'created_time': 1776863506.733881, 'last_price_update_time': 1776863506.733897}
2026-04-22 13:11:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f7fa44ef-0d84-53b1-a743-f913b906492f with identifier: 1481781
2026-04-22 13:11:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f7fa44ef-0d84-53b1-a743-f913b906492f with identifier: 1481781
2026-04-22 13:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f7fa44ef-0d84-53b1-a743-f913b906492f with identifier: 1481781 to the API
2026-04-22 13:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:47 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id f7fa44ef-0d84-53b1-a743-f913b906492f: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:46 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:47 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:47 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'f7fa44ef-0d84-53b1-a743-f913b906492f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'AJ17ZTC',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/B-MAX?id=1481781',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'FORD',
 'model': 'B-MAX',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-08-07',
 'seller_name': None,
 'title': 'FORD B-MAX 1.0 EcoBoost Zetec Silver Edition 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Zetec Silver Edition 5dr',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:47 [manheim.gb] INFO: Saving data for 1481781: {'created_time': 1776863507.096747, 'last_price_update_time': 1776863507.096763}
2026-04-22 13:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2de9b90>
2026-04-22 13:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_9.jpg saved to cache
2026-04-22 13:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 62ee4111-4d4e-5eff-8a8f-903b931caac6
2026-04-22 13:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fe8690>
2026-04-22 13:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_11.jpg saved to cache
2026-04-22 13:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ac30550-f5c2-5524-ab37-486a1ea5672b
2026-04-22 13:11:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4810d9c7-86ce-5895-b5b2-b8bec0a3bb85 with identifier: 1504431
2026-04-22 13:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4810d9c7-86ce-5895-b5b2-b8bec0a3bb85 with scrape type 1
2026-04-22 13:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 4810d9c7-86ce-5895-b5b2-b8bec0a3bb85
2026-04-22 13:11:47 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 4810d9c7-86ce-5895-b5b2-b8bec0a3bb85
2026-04-22 13:11:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4810d9c7-86ce-5895-b5b2-b8bec0a3bb85, identifier: 1504431
2026-04-22 13:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-012.jpg> (referer: None)
2026-04-22 13:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:47 [scrapy.extensions.logstats] INFO: Crawled 61 pages (at 61 pages/min), scraped 22 items (at 22 items/min)
2026-04-22 13:11:47 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-04-22 13:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4810d9c7-86ce-5895-b5b2-b8bec0a3bb85 with identifier: 1504431
2026-04-22 13:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4810d9c7-86ce-5895-b5b2-b8bec0a3bb85 with identifier: 1504431
2026-04-22 13:11:47 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 4810d9c7-86ce-5895-b5b2-b8bec0a3bb85 with identifier: 1504431 to the API
2026-04-22 13:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:47 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 4810d9c7-86ce-5895-b5b2-b8bec0a3bb85: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:47 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:47 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:47 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.8L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '4810d9c7-86ce-5895-b5b2-b8bec0a3bb85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'VK63DLD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/TT?id=1504431',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'AUDI',
 'model': 'TT',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-10-21',
 'seller_name': None,
 'title': 'AUDI TT 1.8T FSI Sport 2dr S Tronic',
 'transmission': 'manual',
 'trim': '1.8T FSI Sport 2dr S Tronic',
 'year': 2013}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:47 [manheim.gb] INFO: Saving data for 1504431: {'created_time': 1776863507.601753, 'last_price_update_time': 1776863507.601764}
2026-04-22 13:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_5.jpg not downloaded yet
2026-04-22 13:11:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3914dd3e-4fc9-5de3-9716-b66348b3fbe8 with identifier: 1440099
2026-04-22 13:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3914dd3e-4fc9-5de3-9716-b66348b3fbe8 with scrape type 1
2026-04-22 13:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3914dd3e-4fc9-5de3-9716-b66348b3fbe8
2026-04-22 13:11:47 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3914dd3e-4fc9-5de3-9716-b66348b3fbe8
2026-04-22 13:11:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3914dd3e-4fc9-5de3-9716-b66348b3fbe8, identifier: 1440099
2026-04-22 13:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2b43110>
2026-04-22 13:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_10.jpg saved to cache
2026-04-22 13:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 62ee4111-4d4e-5eff-8a8f-903b931caac6
2026-04-22 13:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3914dd3e-4fc9-5de3-9716-b66348b3fbe8 with identifier: 1440099
2026-04-22 13:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3914dd3e-4fc9-5de3-9716-b66348b3fbe8 with identifier: 1440099
2026-04-22 13:11:47 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 3914dd3e-4fc9-5de3-9716-b66348b3fbe8 with identifier: 1440099 to the API
2026-04-22 13:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:48 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 3914dd3e-4fc9-5de3-9716-b66348b3fbe8: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:47 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:48 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:48 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester - In Transit',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '3914dd3e-4fc9-5de3-9716-b66348b3fbe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'SO65FDM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/HATCHBACK?id=1440099',
 'listing': 'auction',
 'location': 'Manchester - In Transit',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'HATCHBACK',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-01-12',
 'seller_name': None,
 'title': 'MERCEDES-BENZ HATCHBACK GLA 220d 4Matic AMG Line 5dr Auto [Premium]',
 'transmission': 'automatic',
 'trim': 'GLA 220d 4Matic AMG Line 5dr Auto [Premium]',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:48 [manheim.gb] INFO: Saving data for 1440099: {'created_time': 1776863508.109539, 'last_price_update_time': 1776863508.10955}
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b10642d0>
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_11.jpg saved to cache
2026-04-22 13:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 62ee4111-4d4e-5eff-8a8f-903b931caac6
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1618890>
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_4.jpg saved to cache
2026-04-22 13:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0484f2ed-36fc-582d-9818-27b4340bd7d5
2026-04-22 13:11:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0484f2ed-36fc-582d-9818-27b4340bd7d5, skipping ID generation
2026-04-22 13:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0484f2ed-36fc-582d-9818-27b4340bd7d5 with scrape type 1
2026-04-22 13:11:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0484f2ed-36fc-582d-9818-27b4340bd7d5 sending to next pipeline
2026-04-22 13:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0484f2ed-36fc-582d-9818-27b4340bd7d5, identifier: 1319966
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1046210>
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_4.jpg saved to cache
2026-04-22 13:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 62ee4111-4d4e-5eff-8a8f-903b931caac6
2026-04-22 13:11:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62ee4111-4d4e-5eff-8a8f-903b931caac6, skipping ID generation
2026-04-22 13:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ee4111-4d4e-5eff-8a8f-903b931caac6 with scrape type 1
2026-04-22 13:11:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62ee4111-4d4e-5eff-8a8f-903b931caac6 sending to next pipeline
2026-04-22 13:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 62ee4111-4d4e-5eff-8a8f-903b931caac6, identifier: 1369056
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b17bb150>
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_4.jpg saved to cache
2026-04-22 13:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ac30550-f5c2-5524-ab37-486a1ea5672b
2026-04-22 13:11:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ac30550-f5c2-5524-ab37-486a1ea5672b, skipping ID generation
2026-04-22 13:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac30550-f5c2-5524-ab37-486a1ea5672b with scrape type 1
2026-04-22 13:11:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ac30550-f5c2-5524-ab37-486a1ea5672b sending to next pipeline
2026-04-22 13:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8ac30550-f5c2-5524-ab37-486a1ea5672b, identifier: 1333721
2026-04-22 13:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_7.jpg> (referer: None)
2026-04-22 13:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_1.jpg not downloaded yet
2026-04-22 13:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0484f2ed-36fc-582d-9818-27b4340bd7d5 with identifier: 1319966
2026-04-22 13:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0484f2ed-36fc-582d-9818-27b4340bd7d5 with identifier: 1319966
2026-04-22 13:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0484f2ed-36fc-582d-9818-27b4340bd7d5 with identifier: 1319966 to the API
2026-04-22 13:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:49 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '0484f2ed-36fc-582d-9818-27b4340bd7d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WN62FDK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=1319966',
 'listing': 'auction',
 'location': 'Birmingham',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 54469,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263040,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1319966-4168118-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201285,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185978,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300842,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240314,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231002,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187708,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188791,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177979,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0484f2ed-36fc-582d-9818-27b4340bd7d5/0484f2ed-36fc-582d-9818-27b4340bd7d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197295,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/da9940e9-faae-4575-b2a3-3c3d2e8fee97_4.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2012-09-26',
 'seller_name': None,
 'title': 'VAUXHALL CORSA 1.0 ecoFLEX S 3dr',
 'transmission': 'manual',
 'trim': '1.0 ecoFLEX S 3dr',
 'year': 2012}
2026-04-22 13:11:49 [manheim.gb] INFO: Saving data for 1319966: {'created_time': 1776863509.0269, 'last_price_update_time': 1776863509.026912}
2026-04-22 13:11:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 62ee4111-4d4e-5eff-8a8f-903b931caac6 with identifier: 1369056
2026-04-22 13:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 62ee4111-4d4e-5eff-8a8f-903b931caac6 with identifier: 1369056
2026-04-22 13:11:49 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 62ee4111-4d4e-5eff-8a8f-903b931caac6 with identifier: 1369056 to the API
2026-04-22 13:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'BEIGE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '62ee4111-4d4e-5eff-8a8f-903b931caac6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YY65VEM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/TUCSON?id=1369056',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 50656,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341354,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1369056-4164887-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199632,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229407,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262967,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281595,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255345,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201591,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189136,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196685,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_62ee4111-4d4e-5eff-8a8f-903b931caac6/62ee4111-4d4e-5eff-8a8f-903b931caac6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185968,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e211eb4-d2f6-41ad-98f3-202afb301ae0_4.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-01-19',
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 GDi Blue Drive SE 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 GDi Blue Drive SE 5dr 2WD',
 'year': 2016}
2026-04-22 13:11:50 [manheim.gb] INFO: Saving data for 1369056: {'created_time': 1776863510.205185, 'last_price_update_time': 1776863510.205196}
2026-04-22 13:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8ac30550-f5c2-5524-ab37-486a1ea5672b with identifier: 1333721
2026-04-22 13:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8ac30550-f5c2-5524-ab37-486a1ea5672b with identifier: 1333721
2026-04-22 13:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8ac30550-f5c2-5524-ab37-486a1ea5672b with identifier: 1333721 to the API
2026-04-22 13:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '8ac30550-f5c2-5524-ab37-486a1ea5672b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BK64KTJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=1333721',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 58131,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205233,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1333721-4161303-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167593,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280192,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240986,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338353,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274560,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169353,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156796,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172742,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ac30550-f5c2-5524-ab37-486a1ea5672b/8ac30550-f5c2-5524-ab37-486a1ea5672b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162413,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1c982e-2cfc-4fcd-a018-eed292716f3d_4.jpg',
             'Width': 1500}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-09-24',
 'seller_name': None,
 'title': 'FIAT 500 1.2 Colour Therapy 3dr',
 'transmission': 'manual',
 'trim': '1.2 Colour Therapy 3dr',
 'year': 2014}
2026-04-22 13:11:50 [manheim.gb] INFO: Saving data for 1333721: {'created_time': 1776863510.573569, 'last_price_update_time': 1776863510.573582}
2026-04-22 13:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b177c810>
2026-04-22 13:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-012.jpg saved to cache
2026-04-22 13:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f33f3e7e-88a1-5878-b335-35018b73880c
2026-04-22 13:11:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f33f3e7e-88a1-5878-b335-35018b73880c, skipping ID generation
2026-04-22 13:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f33f3e7e-88a1-5878-b335-35018b73880c with scrape type 1
2026-04-22 13:11:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f33f3e7e-88a1-5878-b335-35018b73880c sending to next pipeline
2026-04-22 13:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f33f3e7e-88a1-5878-b335-35018b73880c, identifier: 1304652
2026-04-22 13:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 935e4775-f9af-55f9-8025-fddbd2898bfb with identifier: 1444956
2026-04-22 13:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 935e4775-f9af-55f9-8025-fddbd2898bfb with scrape type 1
2026-04-22 13:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 935e4775-f9af-55f9-8025-fddbd2898bfb
2026-04-22 13:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-002.jpg not downloaded yet
2026-04-22 13:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_3.jpg> (referer: None)
2026-04-22 13:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f33f3e7e-88a1-5878-b335-35018b73880c with identifier: 1304652
2026-04-22 13:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f33f3e7e-88a1-5878-b335-35018b73880c with identifier: 1304652
2026-04-22 13:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f33f3e7e-88a1-5878-b335-35018b73880c with identifier: 1304652 to the API
2026-04-22 13:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:51 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id f33f3e7e-88a1-5878-b335-35018b73880c: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:50 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:51 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:51 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'f33f3e7e-88a1-5878-b335-35018b73880c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WN15CWD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/TRAFIC?id=1304652',
 'listing': 'auction',
 'location': 'Birmingham',
 'longitude': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274148,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244118,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163176,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257772,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292453,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200620,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250897,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281860,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1304652-4058705-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181938,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f33f3e7e-88a1-5878-b335-35018b73880c/f33f3e7e-88a1-5878-b335-35018b73880c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206638,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1304652-9999999-28084400-011.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-04-30',
 'seller_name': None,
 'title': 'RENAULT TRAFIC SL27dCi 90 Business 9 Seater',
 'transmission': 'manual',
 'trim': 'SL27dCi 90 Business 9 Seater',
 'year': 2015}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:51 [manheim.gb] INFO: Saving data for 1304652: {'created_time': 1776863511.146057, 'last_price_update_time': 1776863511.14607}
2026-04-22 13:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3684954-f8c5-5fe0-bb7e-05a5f911ea88 with identifier: 1442217
2026-04-22 13:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3684954-f8c5-5fe0-bb7e-05a5f911ea88 with scrape type 1
2026-04-22 13:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a3684954-f8c5-5fe0-bb7e-05a5f911ea88
2026-04-22 13:11:51 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a3684954-f8c5-5fe0-bb7e-05a5f911ea88
2026-04-22 13:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a3684954-f8c5-5fe0-bb7e-05a5f911ea88, identifier: 1442217
2026-04-22 13:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_6.jpg not downloaded yet
2026-04-22 13:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-001.jpg not downloaded yet
2026-04-22 13:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a3684954-f8c5-5fe0-bb7e-05a5f911ea88 with identifier: 1442217
2026-04-22 13:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White HTTP/1.1" 200 None
2026-04-22 13:11:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a3684954-f8c5-5fe0-bb7e-05a5f911ea88 with identifier: 1442217
2026-04-22 13:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a3684954-f8c5-5fe0-bb7e-05a5f911ea88 with identifier: 1442217 to the API
2026-04-22 13:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'White',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'a3684954-f8c5-5fe0-bb7e-05a5f911ea88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'LK16TXC',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/DS/DS%203?id=1442217',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'DS',
 'model': 'DS 3',
 'odometer': 73255,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-03-01',
 'seller_name': None,
 'title': 'DS DS 3 1.6 BlueHDi DStyle Nav 3dr',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi DStyle Nav 3dr',
 'year': 2016}
2026-04-22 13:11:51 [manheim.gb] INFO: Saving data for 1442217: {'created_time': 1776863511.817416, 'last_price_update_time': 1776863511.817427}
2026-04-22 13:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_4.jpg> (referer: None)
2026-04-22 13:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b107d5d0>
2026-04-22 13:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_7.jpg saved to cache
2026-04-22 13:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 378a3805-7000-5b3e-ac20-6d18029b836a
2026-04-22 13:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_7.jpg already downloaded
2026-04-22 13:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_4.jpg not downloaded yet
2026-04-22 13:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-008.jpg not downloaded yet
2026-04-22 13:11:51 [manheim.gb] INFO: Page 2: 100 results (total: 14785)
2026-04-22 13:11:51 [manheim.gb] INFO: Found listing with ID: 1504782
2026-04-22 13:11:51 [manheim.gb] INFO: Scrape type for 1504782: 1
2026-04-22 13:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b181e910>
2026-04-22 13:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_3.jpg saved to cache
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 378a3805-7000-5b3e-ac20-6d18029b836a
2026-04-22 13:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1474965-4167108-13.jpg> (referer: None)
2026-04-22 13:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_5.jpg> (referer: None)
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_11.jpg not downloaded yet
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-004.jpg not downloaded yet
2026-04-22 13:11:52 [manheim.gb] INFO: Found listing with ID: 1523080
2026-04-22 13:11:52 [manheim.gb] INFO: Scrape type for 1523080: 0
2026-04-22 13:11:52 [manheim.gb] INFO: Found listing with ID: 1523343
2026-04-22 13:11:52 [manheim.gb] INFO: Scrape type for 1523343: 1
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0515b10>
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_4.jpg saved to cache
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 378a3805-7000-5b3e-ac20-6d18029b836a
2026-04-22 13:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_1.jpg> (referer: None)
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-012.jpg not downloaded yet
2026-04-22 13:11:52 [manheim.gb] INFO: Found listing with ID: 1530202
2026-04-22 13:11:52 [manheim.gb] INFO: Scrape type for 1530202: 1
2026-04-22 13:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-002.jpg> (referer: None)
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-011.jpg not downloaded yet
2026-04-22 13:11:52 [manheim.gb] INFO: Found listing with ID: 1542560
2026-04-22 13:11:52 [manheim.gb] INFO: Scrape type for 1542560: 1
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16c8150>
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1474965-4167108-13.jpg saved to cache
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 378a3805-7000-5b3e-ac20-6d18029b836a
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1706250>
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_5.jpg saved to cache
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 378a3805-7000-5b3e-ac20-6d18029b836a
2026-04-22 13:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-010.jpg not downloaded yet
2026-04-22 13:11:52 [manheim.gb] INFO: Found listing with ID: 1544674
2026-04-22 13:11:52 [manheim.gb] INFO: Scrape type for 1544674: 0
2026-04-22 13:11:52 [manheim.gb] INFO: Found listing with ID: 1550566
2026-04-22 13:11:52 [manheim.gb] INFO: Scrape type for 1550566: 1
2026-04-22 13:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_6.jpg> (referer: None)
2026-04-22 13:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-009.jpg not downloaded yet
2026-04-22 13:11:52 [manheim.gb] INFO: Found listing with ID: 1551459
2026-04-22 13:11:52 [manheim.gb] INFO: Scrape type for 1551459: 1
2026-04-22 13:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-001.jpg> (referer: None)
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b170ba50>
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_1.jpg saved to cache
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 378a3805-7000-5b3e-ac20-6d18029b836a
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0516e50>
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-002.jpg saved to cache
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 935e4775-f9af-55f9-8025-fddbd2898bfb
2026-04-22 13:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_4.jpg> (referer: None)
2026-04-22 13:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-008.jpg> (referer: None)
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-007.jpg not downloaded yet
2026-04-22 13:11:52 [manheim.gb] INFO: Found listing with ID: 1553516
2026-04-22 13:11:52 [manheim.gb] INFO: Scrape type for 1553516: 1
2026-04-22 13:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-004.jpg> (referer: None)
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-006.jpg not downloaded yet
2026-04-22 13:11:52 [manheim.gb] INFO: Found listing with ID: 1554777
2026-04-22 13:11:52 [manheim.gb] INFO: Scrape type for 1554777: 0
2026-04-22 13:11:52 [manheim.gb] INFO: Found listing with ID: 1555018
2026-04-22 13:11:52 [manheim.gb] INFO: Scrape type for 1555018: 1
2026-04-22 13:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_11.jpg> (referer: None)
2026-04-22 13:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f20e5df2-0829-564b-90a4-6377e7242f6c with identifier: 1504782
2026-04-22 13:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f20e5df2-0829-564b-90a4-6377e7242f6c with scrape type 1
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f20e5df2-0829-564b-90a4-6377e7242f6c
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f20e5df2-0829-564b-90a4-6377e7242f6c
2026-04-22 13:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f20e5df2-0829-564b-90a4-6377e7242f6c, identifier: 1504782
2026-04-22 13:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22102235-db48-5a0f-92a9-d9e9e2ce0844 with identifier: 1523343
2026-04-22 13:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22102235-db48-5a0f-92a9-d9e9e2ce0844 with scrape type 1
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 22102235-db48-5a0f-92a9-d9e9e2ce0844
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 22102235-db48-5a0f-92a9-d9e9e2ce0844
2026-04-22 13:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 22102235-db48-5a0f-92a9-d9e9e2ce0844, identifier: 1523343
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2aeec50>
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_6.jpg saved to cache
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 378a3805-7000-5b3e-ac20-6d18029b836a
2026-04-22 13:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c26f7781-7bd9-52cc-9f01-8a322b9908b4 with identifier: 1530202
2026-04-22 13:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c26f7781-7bd9-52cc-9f01-8a322b9908b4 with scrape type 1
2026-04-22 13:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item c26f7781-7bd9-52cc-9f01-8a322b9908b4
2026-04-22 13:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1530202-4166221-13.jpg not downloaded yet
2026-04-22 13:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b181ef50>
2026-04-22 13:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-001.jpg saved to cache
2026-04-22 13:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 935e4775-f9af-55f9-8025-fddbd2898bfb
2026-04-22 13:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-012.jpg> (referer: None)
2026-04-22 13:11:53 [manheim.gb] INFO: Found listing with ID: 1559778
2026-04-22 13:11:53 [manheim.gb] INFO: Scrape type for 1559778: 1
2026-04-22 13:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f20e5df2-0829-564b-90a4-6377e7242f6c with identifier: 1504782
2026-04-22 13:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f20e5df2-0829-564b-90a4-6377e7242f6c with identifier: 1504782
2026-04-22 13:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f20e5df2-0829-564b-90a4-6377e7242f6c with identifier: 1504782 to the API
2026-04-22 13:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:53 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id f20e5df2-0829-564b-90a4-6377e7242f6c: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:52 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:53 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:53 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.7L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'f20e5df2-0829-564b-90a4-6377e7242f6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'CA16PZH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=1504782',
 'listing': 'auction',
 'location': 'Washington - In Transit',
 'longitude': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-06-17',
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.7 CRDi ISG 2 5dr',
 'transmission': 'manual',
 'trim': '1.7 CRDi ISG 2 5dr',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:53 [manheim.gb] INFO: Saving data for 1504782: {'created_time': 1776863513.374658, 'last_price_update_time': 1776863513.374669}
2026-04-22 13:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 22102235-db48-5a0f-92a9-d9e9e2ce0844 with identifier: 1523343
2026-04-22 13:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 22102235-db48-5a0f-92a9-d9e9e2ce0844 with identifier: 1523343
2026-04-22 13:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 22102235-db48-5a0f-92a9-d9e9e2ce0844 with identifier: 1523343 to the API
2026-04-22 13:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:53 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 22102235-db48-5a0f-92a9-d9e9e2ce0844: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:53 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:53 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:53 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '22102235-db48-5a0f-92a9-d9e9e2ce0844',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'PE15EKG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MAZDA/CX-5?id=1523343',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'MAZDA',
 'model': 'CX-5',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-04-02',
 'seller_name': None,
 'title': 'MAZDA CX-5 2.2d SE-L Lux 5dr',
 'transmission': 'manual',
 'trim': '2.2d SE-L Lux 5dr',
 'year': 2015}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:53 [manheim.gb] INFO: Saving data for 1523343: {'created_time': 1776863513.78334, 'last_price_update_time': 1776863513.783352}
2026-04-22 13:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-011.jpg> (referer: None)
2026-04-22 13:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1530202-4166221-3.jpg not downloaded yet
2026-04-22 13:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b167aa10>
2026-04-22 13:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_4.jpg saved to cache
2026-04-22 13:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 378a3805-7000-5b3e-ac20-6d18029b836a
2026-04-22 13:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0562250>
2026-04-22 13:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-008.jpg saved to cache
2026-04-22 13:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 935e4775-f9af-55f9-8025-fddbd2898bfb
2026-04-22 13:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:54 [manheim.gb] INFO: Found listing with ID: 1562438
2026-04-22 13:11:54 [manheim.gb] INFO: Scrape type for 1562438: 1
2026-04-22 13:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2026-04-22 13:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b107acd0>
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-004.jpg saved to cache
2026-04-22 13:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 935e4775-f9af-55f9-8025-fddbd2898bfb
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1031e50>
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_11.jpg saved to cache
2026-04-22 13:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 378a3805-7000-5b3e-ac20-6d18029b836a
2026-04-22 13:11:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 378a3805-7000-5b3e-ac20-6d18029b836a, skipping ID generation
2026-04-22 13:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 378a3805-7000-5b3e-ac20-6d18029b836a with scrape type 1
2026-04-22 13:11:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 378a3805-7000-5b3e-ac20-6d18029b836a sending to next pipeline
2026-04-22 13:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 378a3805-7000-5b3e-ac20-6d18029b836a, identifier: 1474965
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0745dd0>
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-012.jpg saved to cache
2026-04-22 13:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 935e4775-f9af-55f9-8025-fddbd2898bfb
2026-04-22 13:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-010.jpg> (referer: None)
2026-04-22 13:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-007.jpg> (referer: None)
2026-04-22 13:11:54 [manheim.gb] INFO: Found listing with ID: 1568040
2026-04-22 13:11:54 [manheim.gb] INFO: Scrape type for 1568040: 0
2026-04-22 13:11:54 [manheim.gb] INFO: Found listing with ID: 1568770
2026-04-22 13:11:54 [manheim.gb] INFO: Scrape type for 1568770: 0
2026-04-22 13:11:54 [manheim.gb] INFO: Found listing with ID: 1573005
2026-04-22 13:11:54 [manheim.gb] INFO: Scrape type for 1573005: 0
2026-04-22 13:11:54 [manheim.gb] INFO: Found listing with ID: 1583133
2026-04-22 13:11:54 [manheim.gb] INFO: Scrape type for 1583133: 0
2026-04-22 13:11:54 [manheim.gb] INFO: Found listing with ID: 1584865
2026-04-22 13:11:54 [manheim.gb] INFO: Scrape type for 1584865: 0
2026-04-22 13:11:54 [manheim.gb] INFO: Found listing with ID: 1589560
2026-04-22 13:11:54 [manheim.gb] INFO: Scrape type for 1589560: 1
2026-04-22 13:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 378a3805-7000-5b3e-ac20-6d18029b836a with identifier: 1474965
2026-04-22 13:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 378a3805-7000-5b3e-ac20-6d18029b836a with identifier: 1474965
2026-04-22 13:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 378a3805-7000-5b3e-ac20-6d18029b836a with identifier: 1474965 to the API
2026-04-22 13:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_11.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '378a3805-7000-5b3e-ac20-6d18029b836a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'HY17VMG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/KADJAR?id=1474965',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'RENAULT',
 'model': 'KADJAR',
 'odometer': 75296,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265037,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213887,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213887,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310987,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314474,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1474965-4167108-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201283,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141618,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306685,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200217,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_378a3805-7000-5b3e-ac20-6d18029b836a/378a3805-7000-5b3e-ac20-6d18029b836a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198170,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/096d66ec-29e8-4655-875b-fb97919b5eaf_11.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-01',
 'seller_name': None,
 'title': 'RENAULT KADJAR 1.6 dCi Signature Nav 5dr 4WD',
 'transmission': 'manual',
 'trim': '1.6 dCi Signature Nav 5dr 4WD',
 'year': 2017}
2026-04-22 13:11:54 [manheim.gb] INFO: Saving data for 1474965: {'created_time': 1776863514.956192, 'last_price_update_time': 1776863514.956202}
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b070a690>
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-011.jpg saved to cache
2026-04-22 13:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 935e4775-f9af-55f9-8025-fddbd2898bfb
2026-04-22 13:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db1da19b-f73d-55a4-aa23-93669c84ce32 with identifier: 1542560
2026-04-22 13:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db1da19b-f73d-55a4-aa23-93669c84ce32 with scrape type 1
2026-04-22 13:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item db1da19b-f73d-55a4-aa23-93669c84ce32
2026-04-22 13:11:55 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item db1da19b-f73d-55a4-aa23-93669c84ce32
2026-04-22 13:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: db1da19b-f73d-55a4-aa23-93669c84ce32, identifier: 1542560
2026-04-22 13:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4991dc6-3967-515f-bc5f-526e23a933a4 with identifier: 1551459
2026-04-22 13:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4991dc6-3967-515f-bc5f-526e23a933a4 with scrape type 1
2026-04-22 13:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b4991dc6-3967-515f-bc5f-526e23a933a4
2026-04-22 13:11:55 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b4991dc6-3967-515f-bc5f-526e23a933a4
2026-04-22 13:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b4991dc6-3967-515f-bc5f-526e23a933a4, identifier: 1551459
2026-04-22 13:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-009.jpg> (referer: None)
2026-04-22 13:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: db1da19b-f73d-55a4-aa23-93669c84ce32 with identifier: 1542560
2026-04-22 13:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: db1da19b-f73d-55a4-aa23-93669c84ce32 with identifier: 1542560
2026-04-22 13:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: db1da19b-f73d-55a4-aa23-93669c84ce32 with identifier: 1542560 to the API
2026-04-22 13:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:55 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id db1da19b-f73d-55a4-aa23-93669c84ce32: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:55 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:55 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:55 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'db1da19b-f73d-55a4-aa23-93669c84ce32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DV16FLR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/3%20SERIES?id=1542560',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'BMW',
 'model': '3 SERIES',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-03-31',
 'seller_name': None,
 'title': 'BMW 3 SERIES 335d xDrive M Sport 5dr Step Auto [Business Media]',
 'transmission': 'automatic',
 'trim': '335d xDrive M Sport 5dr Step Auto [Business Media]',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:55 [manheim.gb] INFO: Saving data for 1542560: {'created_time': 1776863515.569708, 'last_price_update_time': 1776863515.56972}
2026-04-22 13:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b4991dc6-3967-515f-bc5f-526e23a933a4 with identifier: 1551459
2026-04-22 13:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b4991dc6-3967-515f-bc5f-526e23a933a4 with identifier: 1551459
2026-04-22 13:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b4991dc6-3967-515f-bc5f-526e23a933a4 with identifier: 1551459 to the API
2026-04-22 13:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'Blue',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'b4991dc6-3967-515f-bc5f-526e23a933a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'EF15XED',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=1551459',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 57775,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'FORD FIESTA 1.25 82 Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.25 82 Zetec 5dr',
 'year': 2015}
2026-04-22 13:11:55 [manheim.gb] INFO: Saving data for 1551459: {'created_time': 1776863515.936834, 'last_price_update_time': 1776863515.936846}
2026-04-22 13:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1530202-4166221-13.jpg> (referer: None)
2026-04-22 13:11:55 [manheim.gb] INFO: Found listing with ID: 1595502
2026-04-22 13:11:55 [manheim.gb] INFO: Scrape type for 1595502: 1
2026-04-22 13:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1530202-4166221-3.jpg> (referer: None)
2026-04-22 13:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fe018f5-a936-50d4-a95f-a476e1f3ca69 with identifier: 1550566
2026-04-22 13:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe018f5-a936-50d4-a95f-a476e1f3ca69 with scrape type 1
2026-04-22 13:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 8fe018f5-a936-50d4-a95f-a476e1f3ca69
2026-04-22 13:11:56 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 8fe018f5-a936-50d4-a95f-a476e1f3ca69
2026-04-22 13:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8fe018f5-a936-50d4-a95f-a476e1f3ca69, identifier: 1550566
2026-04-22 13:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99b305d8-e323-57c8-9434-f726854dfcfc with identifier: 1553516
2026-04-22 13:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99b305d8-e323-57c8-9434-f726854dfcfc with scrape type 1
2026-04-22 13:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 99b305d8-e323-57c8-9434-f726854dfcfc
2026-04-22 13:11:56 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 99b305d8-e323-57c8-9434-f726854dfcfc
2026-04-22 13:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 99b305d8-e323-57c8-9434-f726854dfcfc, identifier: 1553516
2026-04-22 13:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b07603d0>
2026-04-22 13:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-010.jpg saved to cache
2026-04-22 13:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 935e4775-f9af-55f9-8025-fddbd2898bfb
2026-04-22 13:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fad2d0>
2026-04-22 13:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-007.jpg saved to cache
2026-04-22 13:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 935e4775-f9af-55f9-8025-fddbd2898bfb
2026-04-22 13:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-006.jpg> (referer: None)
2026-04-22 13:11:56 [manheim.gb] INFO: Found listing with ID: 1613788
2026-04-22 13:11:56 [manheim.gb] INFO: Scrape type for 1613788: 1
2026-04-22 13:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8fe018f5-a936-50d4-a95f-a476e1f3ca69 with identifier: 1550566
2026-04-22 13:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8fe018f5-a936-50d4-a95f-a476e1f3ca69 with identifier: 1550566
2026-04-22 13:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8fe018f5-a936-50d4-a95f-a476e1f3ca69 with identifier: 1550566 to the API
2026-04-22 13:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'White',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '8fe018f5-a936-50d4-a95f-a476e1f3ca69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KS17EBK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=1550566',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'CITROEN',
 'model': 'C3',
 'odometer': 57715,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-04-28',
 'seller_name': None,
 'title': 'CITROEN C3 1.2 PureTech 82 Feel 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 82 Feel 5dr',
 'year': 2017}
2026-04-22 13:11:56 [manheim.gb] INFO: Saving data for 1550566: {'created_time': 1776863516.668288, 'last_price_update_time': 1776863516.668302}
2026-04-22 13:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 99b305d8-e323-57c8-9434-f726854dfcfc with identifier: 1553516
2026-04-22 13:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 99b305d8-e323-57c8-9434-f726854dfcfc with identifier: 1553516
2026-04-22 13:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 99b305d8-e323-57c8-9434-f726854dfcfc with identifier: 1553516 to the API
2026-04-22 13:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Shotts',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '99b305d8-e323-57c8-9434-f726854dfcfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'RE67ONO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=1553516',
 'listing': 'auction',
 'location': 'Shotts',
 'longitude': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 93130,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-11-23',
 'seller_name': None,
 'title': 'AUDI A3 1.6 TDI 116 S Line 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDI 116 S Line 5dr',
 'year': 2017}
2026-04-22 13:11:57 [manheim.gb] INFO: Saving data for 1553516: {'created_time': 1776863517.010941, 'last_price_update_time': 1776863517.010953}
2026-04-22 13:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1716890>
2026-04-22 13:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-009.jpg saved to cache
2026-04-22 13:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 935e4775-f9af-55f9-8025-fddbd2898bfb
2026-04-22 13:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e176432-e52e-5d1c-bd96-2dab7f528ba4 with identifier: 1555018
2026-04-22 13:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e176432-e52e-5d1c-bd96-2dab7f528ba4 with scrape type 1
2026-04-22 13:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3e176432-e52e-5d1c-bd96-2dab7f528ba4
2026-04-22 13:11:57 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3e176432-e52e-5d1c-bd96-2dab7f528ba4
2026-04-22 13:11:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3e176432-e52e-5d1c-bd96-2dab7f528ba4, identifier: 1555018
2026-04-22 13:11:57 [manheim.gb] INFO: Found listing with ID: 1616203
2026-04-22 13:11:57 [manheim.gb] INFO: Scrape type for 1616203: 1
2026-04-22 13:11:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3e176432-e52e-5d1c-bd96-2dab7f528ba4 with identifier: 1555018
2026-04-22 13:11:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3e176432-e52e-5d1c-bd96-2dab7f528ba4 with identifier: 1555018
2026-04-22 13:11:57 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 3e176432-e52e-5d1c-bd96-2dab7f528ba4 with identifier: 1555018 to the API
2026-04-22 13:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:11:57 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 3e176432-e52e-5d1c-bd96-2dab7f528ba4: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:11:57 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:11:57 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:57 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Plymouth - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '3e176432-e52e-5d1c-bd96-2dab7f528ba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'HG64JKO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/CADDY?id=1555018',
 'listing': 'auction',
 'location': 'Plymouth - In Transit',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-01-13',
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY 1.6 TDI BlueMotion Tech 102PS Startline Van',
 'transmission': 'manual',
 'trim': '1.6 TDI BlueMotion Tech 102PS Startline Van',
 'year': 2015}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:11:57 [manheim.gb] INFO: Saving data for 1555018: {'created_time': 1776863517.640945, 'last_price_update_time': 1776863517.640958}
2026-04-22 13:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3 with identifier: 1559778
2026-04-22 13:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3 with scrape type 1
2026-04-22 13:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3
2026-04-22 13:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1559778-4169735-13.jpg not downloaded yet
2026-04-22 13:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0768bd0>
2026-04-22 13:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c26f7781-7bd9-52cc-9f01-8a322b9908b4/c26f7781-7bd9-52cc-9f01-8a322b9908b4_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1530202-4166221-13.jpg saved to cache
2026-04-22 13:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c26f7781-7bd9-52cc-9f01-8a322b9908b4
2026-04-22 13:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04f2850>
2026-04-22 13:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c26f7781-7bd9-52cc-9f01-8a322b9908b4/c26f7781-7bd9-52cc-9f01-8a322b9908b4_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1530202-4166221-3.jpg saved to cache
2026-04-22 13:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c26f7781-7bd9-52cc-9f01-8a322b9908b4
2026-04-22 13:11:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c26f7781-7bd9-52cc-9f01-8a322b9908b4, skipping ID generation
2026-04-22 13:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c26f7781-7bd9-52cc-9f01-8a322b9908b4 with scrape type 1
2026-04-22 13:11:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c26f7781-7bd9-52cc-9f01-8a322b9908b4 sending to next pipeline
2026-04-22 13:11:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c26f7781-7bd9-52cc-9f01-8a322b9908b4, identifier: 1530202
2026-04-22 13:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c26f7781-7bd9-52cc-9f01-8a322b9908b4 with identifier: 1530202
2026-04-22 13:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Manufacturer+Colour HTTP/1.1" 200 None
2026-04-22 13:11:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c26f7781-7bd9-52cc-9f01-8a322b9908b4 with identifier: 1530202
2026-04-22 13:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: c26f7781-7bd9-52cc-9f01-8a322b9908b4 with identifier: 1530202 to the API
2026-04-22 13:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:58 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-1530202-4166221-3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'INTERNAL',
 'color': 'Manufacturer Colour',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'c26f7781-7bd9-52cc-9f01-8a322b9908b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'NV63BXR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/PARTNER?id=1530202',
 'listing': 'auction',
 'location': 'INTERNAL',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 67676,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c26f7781-7bd9-52cc-9f01-8a322b9908b4/c26f7781-7bd9-52cc-9f01-8a322b9908b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84104,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1530202-4166221-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_410ff630-6543-5547-ae72-a20ded1fd770/410ff630-6543-5547-ae72-a20ded1fd770_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_410ff630-6543-5547-ae72-a20ded1fd770/410ff630-6543-5547-ae72-a20ded1fd770_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c26f7781-7bd9-52cc-9f01-8a322b9908b4/c26f7781-7bd9-52cc-9f01-8a322b9908b4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92081,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1530202-4166221-3.jpg',
             'Width': 1500}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-11-30',
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 750 S 1.6 HDi 92 Van',
 'transmission': 'manual',
 'trim': '750 S 1.6 HDi 92 Van',
 'year': 2013}
2026-04-22 13:11:58 [manheim.gb] INFO: Saving data for 1530202: {'created_time': 1776863518.377057, 'last_price_update_time': 1776863518.377071}
2026-04-22 13:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05d9410>
2026-04-22 13:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-006.jpg saved to cache
2026-04-22 13:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 935e4775-f9af-55f9-8025-fddbd2898bfb
2026-04-22 13:11:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 935e4775-f9af-55f9-8025-fddbd2898bfb, skipping ID generation
2026-04-22 13:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 935e4775-f9af-55f9-8025-fddbd2898bfb with scrape type 1
2026-04-22 13:11:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 935e4775-f9af-55f9-8025-fddbd2898bfb sending to next pipeline
2026-04-22 13:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 935e4775-f9af-55f9-8025-fddbd2898bfb, identifier: 1444956
2026-04-22 13:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:58 [manheim.gb] INFO: Found listing with ID: 161795
2026-04-22 13:11:58 [manheim.gb] INFO: Scrape type for 161795: 1
2026-04-22 13:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_7.jpg not downloaded yet
2026-04-22 13:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 935e4775-f9af-55f9-8025-fddbd2898bfb with identifier: 1444956
2026-04-22 13:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:11:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY+AND+BLACK HTTP/1.1" 200 None
2026-04-22 13:11:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 935e4775-f9af-55f9-8025-fddbd2898bfb with identifier: 1444956
2026-04-22 13:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 935e4775-f9af-55f9-8025-fddbd2898bfb with identifier: 1444956 to the API
2026-04-22 13:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-006.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington',
 'color': 'GREY AND BLACK',
 'currency': 'GBP',
 'engine': '0.9L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '935e4775-f9af-55f9-8025-fddbd2898bfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'HS17HMV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=1444956',
 'listing': 'auction',
 'location': 'Washington',
 'longitude': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 59789,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224678,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239183,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261795,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316429,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229840,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253142,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270360,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296100,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249451,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935e4775-f9af-55f9-8025-fddbd2898bfb/935e4775-f9af-55f9-8025-fddbd2898bfb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222263,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1444956-9999999-112092921-006.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-07-25',
 'seller_name': None,
 'title': 'RENAULT CAPTUR 0.9 TCE 90 Dynamique Nav 5dr',
 'transmission': 'manual',
 'trim': '0.9 TCE 90 Dynamique Nav 5dr',
 'year': 2017}
2026-04-22 13:11:59 [manheim.gb] INFO: Saving data for 1444956: {'created_time': 1776863519.107546, 'last_price_update_time': 1776863519.107558}
2026-04-22 13:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8625c0c2-30e0-55d5-8490-1fd89da7281a with identifier: 1562438
2026-04-22 13:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8625c0c2-30e0-55d5-8490-1fd89da7281a with scrape type 1
2026-04-22 13:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8625c0c2-30e0-55d5-8490-1fd89da7281a
2026-04-22 13:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_7.jpg not downloaded yet
2026-04-22 13:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:59 [manheim.gb] INFO: Found listing with ID: 1627772
2026-04-22 13:11:59 [manheim.gb] INFO: Scrape type for 1627772: 1
2026-04-22 13:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_4.jpg not downloaded yet
2026-04-22 13:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_7.jpg not downloaded yet
2026-04-22 13:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0 with identifier: 1589560
2026-04-22 13:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0 with scrape type 1
2026-04-22 13:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0
2026-04-22 13:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_7.jpg not downloaded yet
2026-04-22 13:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31d5a852-6f22-502a-ab01-c9b3d66fc37b with identifier: 1595502
2026-04-22 13:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31d5a852-6f22-502a-ab01-c9b3d66fc37b with scrape type 1
2026-04-22 13:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 31d5a852-6f22-502a-ab01-c9b3d66fc37b
2026-04-22 13:11:59 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 31d5a852-6f22-502a-ab01-c9b3d66fc37b
2026-04-22 13:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 31d5a852-6f22-502a-ab01-c9b3d66fc37b, identifier: 1595502
2026-04-22 13:11:59 [manheim.gb] INFO: Found listing with ID: 1632598
2026-04-22 13:11:59 [manheim.gb] INFO: Scrape type for 1632598: 0
2026-04-22 13:11:59 [manheim.gb] INFO: Found listing with ID: 1646445
2026-04-22 13:11:59 [manheim.gb] INFO: Scrape type for 1646445: 0
2026-04-22 13:11:59 [manheim.gb] INFO: Found listing with ID: 1648604
2026-04-22 13:11:59 [manheim.gb] INFO: Scrape type for 1648604: 0
2026-04-22 13:11:59 [manheim.gb] INFO: Found listing with ID: 16508
2026-04-22 13:11:59 [manheim.gb] INFO: Scrape type for 16508: 0
2026-04-22 13:11:59 [manheim.gb] INFO: Found listing with ID: 1651581
2026-04-22 13:11:59 [manheim.gb] INFO: Scrape type for 1651581: 1
2026-04-22 13:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_3.jpg not downloaded yet
2026-04-22 13:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 31d5a852-6f22-502a-ab01-c9b3d66fc37b with identifier: 1595502
2026-04-22 13:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 31d5a852-6f22-502a-ab01-c9b3d66fc37b with identifier: 1595502
2026-04-22 13:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 31d5a852-6f22-502a-ab01-c9b3d66fc37b with identifier: 1595502 to the API
2026-04-22 13:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:11:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '31d5a852-6f22-502a-ab01-c9b3d66fc37b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'FD15BVT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/CEED?id=1595502',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'KIA',
 'model': 'CEED',
 'odometer': 111220,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-05-29',
 'seller_name': None,
 'title': 'KIA CEED 1.6 CRDi 3 EcoDynamics 5dr',
 'transmission': 'manual',
 'trim': '1.6 CRDi 3 EcoDynamics 5dr',
 'year': 2015}
2026-04-22 13:11:59 [manheim.gb] INFO: Saving data for 1595502: {'created_time': 1776863519.909061, 'last_price_update_time': 1776863519.909074}
2026-04-22 13:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_6.jpg not downloaded yet
2026-04-22 13:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_7.jpg not downloaded yet
2026-04-22 13:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:11:59 [manheim.gb] INFO: Found listing with ID: 1655165
2026-04-22 13:11:59 [manheim.gb] INFO: Scrape type for 1655165: 1
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_5.jpg not downloaded yet
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_1.jpg not downloaded yet
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_6.jpg not downloaded yet
2026-04-22 13:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0855152-86d2-569d-81fe-1282309155b3 with identifier: 1613788
2026-04-22 13:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0855152-86d2-569d-81fe-1282309155b3 with scrape type 1
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item d0855152-86d2-569d-81fe-1282309155b3
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item d0855152-86d2-569d-81fe-1282309155b3
2026-04-22 13:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d0855152-86d2-569d-81fe-1282309155b3, identifier: 1613788
2026-04-22 13:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_7.jpg> (referer: None)
2026-04-22 13:12:00 [manheim.gb] INFO: Found listing with ID: 1661707
2026-04-22 13:12:00 [manheim.gb] INFO: Scrape type for 1661707: 0
2026-04-22 13:12:00 [manheim.gb] INFO: Found listing with ID: 1662912
2026-04-22 13:12:00 [manheim.gb] INFO: Scrape type for 1662912: 0
2026-04-22 13:12:00 [manheim.gb] INFO: Found listing with ID: 166393
2026-04-22 13:12:00 [manheim.gb] INFO: Scrape type for 166393: 1
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_2.jpg not downloaded yet
2026-04-22 13:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d0855152-86d2-569d-81fe-1282309155b3 with identifier: 1613788
2026-04-22 13:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d0855152-86d2-569d-81fe-1282309155b3 with identifier: 1613788
2026-04-22 13:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: d0855152-86d2-569d-81fe-1282309155b3 with identifier: 1613788 to the API
2026-04-22 13:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:00 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id d0855152-86d2-569d-81fe-1282309155b3: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:00 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:00 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:00 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'd0855152-86d2-569d-81fe-1282309155b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'HG12SVY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C1?id=1613788',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'CITROEN',
 'model': 'C1',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2012-08-23',
 'seller_name': None,
 'title': 'CITROEN C1 1.0i VTR 5dr',
 'transmission': 'manual',
 'trim': '1.0i VTR 5dr',
 'year': 2012}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:00 [manheim.gb] INFO: Saving data for 1613788: {'created_time': 1776863520.563535, 'last_price_update_time': 1776863520.563548}
2026-04-22 13:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1559778-4169735-13.jpg> (referer: None)
2026-04-22 13:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_7.jpg> (referer: None)
2026-04-22 13:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_5.jpg not downloaded yet
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_1.jpg not downloaded yet
2026-04-22 13:12:00 [manheim.gb] INFO: Found listing with ID: 1674431
2026-04-22 13:12:00 [manheim.gb] INFO: Scrape type for 1674431: 1
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_9.jpg not downloaded yet
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_4.jpg not downloaded yet
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_5.jpg not downloaded yet
2026-04-22 13:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1830dce-89f6-5501-aa78-9460a6b30c59 with identifier: 1616203
2026-04-22 13:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1830dce-89f6-5501-aa78-9460a6b30c59 with scrape type 1
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1830dce-89f6-5501-aa78-9460a6b30c59
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_7.jpg not downloaded yet
2026-04-22 13:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf65af01-b8ff-5c87-bcaf-4abd252c004d with identifier: 161795
2026-04-22 13:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf65af01-b8ff-5c87-bcaf-4abd252c004d with scrape type 1
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item cf65af01-b8ff-5c87-bcaf-4abd252c004d
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item cf65af01-b8ff-5c87-bcaf-4abd252c004d
2026-04-22 13:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cf65af01-b8ff-5c87-bcaf-4abd252c004d, identifier: 161795
2026-04-22 13:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b072b0d0>
2026-04-22 13:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_7.jpg saved to cache
2026-04-22 13:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3
2026-04-22 13:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_4.jpg> (referer: None)
2026-04-22 13:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_7.jpg> (referer: None)
2026-04-22 13:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_7.jpg> (referer: None)
2026-04-22 13:12:00 [manheim.gb] INFO: Found listing with ID: 1675583
2026-04-22 13:12:00 [manheim.gb] INFO: Scrape type for 1675583: 0
2026-04-22 13:12:00 [manheim.gb] INFO: Found listing with ID: 1682577
2026-04-22 13:12:00 [manheim.gb] INFO: Scrape type for 1682577: 0
2026-04-22 13:12:00 [manheim.gb] INFO: Found listing with ID: 1683671
2026-04-22 13:12:00 [manheim.gb] INFO: Scrape type for 1683671: 0
2026-04-22 13:12:00 [manheim.gb] INFO: Found listing with ID: 1704877
2026-04-22 13:12:01 [manheim.gb] INFO: Scrape type for 1704877: 2
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_10.jpg not downloaded yet
2026-04-22 13:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cf65af01-b8ff-5c87-bcaf-4abd252c004d with identifier: 161795
2026-04-22 13:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cf65af01-b8ff-5c87-bcaf-4abd252c004d with identifier: 161795
2026-04-22 13:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cf65af01-b8ff-5c87-bcaf-4abd252c004d with identifier: 161795 to the API
2026-04-22 13:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:01 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id cf65af01-b8ff-5c87-bcaf-4abd252c004d: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:00 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:01 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:01 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'cf65af01-b8ff-5c87-bcaf-4abd252c004d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'VA14DZO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=161795',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-06-26',
 'seller_name': None,
 'title': 'NISSAN JUKE 1.5 dCi Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi Tekna 5dr',
 'year': 2014}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:01 [manheim.gb] INFO: Saving data for 161795: {'created_time': 1776863521.344187, 'last_price_update_time': 1776863521.344205}
2026-04-22 13:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_6.jpg> (referer: None)
2026-04-22 13:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_7.jpg> (referer: None)
2026-04-22 13:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_11.jpg not downloaded yet
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_4.jpg not downloaded yet
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_7.jpg not downloaded yet
2026-04-22 13:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:01 [manheim.gb] INFO: Found listing with ID: 1708092
2026-04-22 13:12:01 [manheim.gb] INFO: Scrape type for 1708092: 1
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_11.jpg not downloaded yet
2026-04-22 13:12:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06746d0>
2026-04-22 13:12:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1559778-4169735-13.jpg saved to cache
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3
2026-04-22 13:12:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b108f210>
2026-04-22 13:12:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_7.jpg saved to cache
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8625c0c2-30e0-55d5-8490-1fd89da7281a
2026-04-22 13:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0412807-0a74-51c7-b93c-ccb8c470d639 with identifier: 1627772
2026-04-22 13:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0412807-0a74-51c7-b93c-ccb8c470d639 with scrape type 1
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f0412807-0a74-51c7-b93c-ccb8c470d639
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f0412807-0a74-51c7-b93c-ccb8c470d639
2026-04-22 13:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f0412807-0a74-51c7-b93c-ccb8c470d639, identifier: 1627772
2026-04-22 13:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_10.jpg not downloaded yet
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_11.jpg not downloaded yet
2026-04-22 13:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_6.jpg not downloaded yet
2026-04-22 13:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f0412807-0a74-51c7-b93c-ccb8c470d639 with identifier: 1627772
2026-04-22 13:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f0412807-0a74-51c7-b93c-ccb8c470d639 with identifier: 1627772
2026-04-22 13:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f0412807-0a74-51c7-b93c-ccb8c470d639 with identifier: 1627772 to the API
2026-04-22 13:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:02 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id f0412807-0a74-51c7-b93c-ccb8c470d639: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:01 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:02 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:02 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.7L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'f0412807-0a74-51c7-b93c-ccb8c470d639',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'MA63VYP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=1627772',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-10-18',
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.7 CRDi ISG 2 5dr',
 'transmission': 'manual',
 'trim': '1.7 CRDi ISG 2 5dr',
 'year': 2013}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:02 [manheim.gb] INFO: Saving data for 1627772: {'created_time': 1776863522.216958, 'last_price_update_time': 1776863522.21697}
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04f5690>
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_4.jpg saved to cache
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05e3610>
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_7.jpg saved to cache
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1001310>
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_7.jpg saved to cache
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8625c0c2-30e0-55d5-8490-1fd89da7281a
2026-04-22 13:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_3.jpg> (referer: None)
2026-04-22 13:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_5.jpg> (referer: None)
2026-04-22 13:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:02 [manheim.gb] INFO: Found listing with ID: 1716602
2026-04-22 13:12:02 [manheim.gb] INFO: Scrape type for 1716602: 0
2026-04-22 13:12:02 [manheim.gb] INFO: Found listing with ID: 1719452
2026-04-22 13:12:02 [manheim.gb] INFO: Scrape type for 1719452: 0
2026-04-22 13:12:02 [manheim.gb] INFO: Found listing with ID: 1719909
2026-04-22 13:12:02 [manheim.gb] INFO: Scrape type for 1719909: 1
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_4.jpg not downloaded yet
2026-04-22 13:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_6.jpg> (referer: None)
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_9.jpg not downloaded yet
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_10.jpg not downloaded yet
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1616203-4166609-13.jpg not downloaded yet
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1661290>
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_6.jpg saved to cache
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8625c0c2-30e0-55d5-8490-1fd89da7281a
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04db190>
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_7.jpg saved to cache
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0
2026-04-22 13:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f42863da-e1a0-5c79-bc1b-e2b4a8429b77 with identifier: 1651581
2026-04-22 13:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77 with scrape type 1
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1651581-4169581-13.jpg not downloaded yet
2026-04-22 13:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dc6b9b2-a249-5186-be61-1b5c67f9e00a with identifier: 1655165
2026-04-22 13:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dc6b9b2-a249-5186-be61-1b5c67f9e00a with scrape type 1
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 8dc6b9b2-a249-5186-be61-1b5c67f9e00a
2026-04-22 13:12:02 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 8dc6b9b2-a249-5186-be61-1b5c67f9e00a
2026-04-22 13:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8dc6b9b2-a249-5186-be61-1b5c67f9e00a, identifier: 1655165
2026-04-22 13:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_1.jpg> (referer: None)
2026-04-22 13:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_9.jpg> (referer: None)
2026-04-22 13:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:02 [manheim.gb] INFO: Found listing with ID: 1720405
2026-04-22 13:12:02 [manheim.gb] INFO: Scrape type for 1720405: 1
2026-04-22 13:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8dc6b9b2-a249-5186-be61-1b5c67f9e00a with identifier: 1655165
2026-04-22 13:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8dc6b9b2-a249-5186-be61-1b5c67f9e00a with identifier: 1655165
2026-04-22 13:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8dc6b9b2-a249-5186-be61-1b5c67f9e00a with identifier: 1655165 to the API
2026-04-22 13:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '8dc6b9b2-a249-5186-be61-1b5c67f9e00a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'HG55YOE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=1655165',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 82123,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2006-02-15',
 'seller_name': None,
 'title': 'MINI HATCHBACK 1.6 One 3dr',
 'transmission': 'manual',
 'trim': '1.6 One 3dr',
 'year': 2006}
2026-04-22 13:12:03 [manheim.gb] INFO: Saving data for 1655165: {'created_time': 1776863523.2275, 'last_price_update_time': 1776863523.227511}
2026-04-22 13:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c2b72b3-0ce4-5499-9c85-5ab2a7f1e20b with identifier: 166393
2026-04-22 13:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c2b72b3-0ce4-5499-9c85-5ab2a7f1e20b with scrape type 1
2026-04-22 13:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7c2b72b3-0ce4-5499-9c85-5ab2a7f1e20b
2026-04-22 13:12:03 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7c2b72b3-0ce4-5499-9c85-5ab2a7f1e20b
2026-04-22 13:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 7c2b72b3-0ce4-5499-9c85-5ab2a7f1e20b, identifier: 166393
2026-04-22 13:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_5.jpg> (referer: None)
2026-04-22 13:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_2.jpg> (referer: None)
2026-04-22 13:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_2.jpg not downloaded yet
2026-04-22 13:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_9.jpg not downloaded yet
2026-04-22 13:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_4.jpg not downloaded yet
2026-04-22 13:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-004.jpg not downloaded yet
2026-04-22 13:12:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 7c2b72b3-0ce4-5499-9c85-5ab2a7f1e20b with identifier: 166393
2026-04-22 13:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 7c2b72b3-0ce4-5499-9c85-5ab2a7f1e20b with identifier: 166393
2026-04-22 13:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 7c2b72b3-0ce4-5499-9c85-5ab2a7f1e20b with identifier: 166393 to the API
2026-04-22 13:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester - In Transit',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '7c2b72b3-0ce4-5499-9c85-5ab2a7f1e20b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DP11KFD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/3%20SERIES?id=166393',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'longitude': None,
 'make': 'BMW',
 'model': '3 SERIES',
 'odometer': 113193,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2011-08-08',
 'seller_name': None,
 'title': 'BMW 3 SERIES 320d [184] Exclusive Edition 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '320d [184] Exclusive Edition 4dr Step Auto',
 'year': 2011}
2026-04-22 13:12:03 [manheim.gb] INFO: Saving data for 166393: {'created_time': 1776863523.770276, 'last_price_update_time': 1776863523.770288}
2026-04-22 13:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_1.jpg> (referer: None)
2026-04-22 13:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:03 [manheim.gb] INFO: Found listing with ID: 1727286
2026-04-22 13:12:03 [manheim.gb] INFO: Scrape type for 1727286: 0
2026-04-22 13:12:03 [manheim.gb] INFO: Found listing with ID: 1731345
2026-04-22 13:12:03 [manheim.gb] INFO: Scrape type for 1731345: 0
2026-04-22 13:12:03 [manheim.gb] INFO: Found listing with ID: 1736712
2026-04-22 13:12:03 [manheim.gb] INFO: Scrape type for 1736712: 1
2026-04-22 13:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1659950>
2026-04-22 13:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_3.jpg saved to cache
2026-04-22 13:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3
2026-04-22 13:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06fe190>
2026-04-22 13:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_5.jpg saved to cache
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3
2026-04-22 13:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46f1c2af-d305-5f14-8b5e-85d1274da400 with identifier: 1674431
2026-04-22 13:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46f1c2af-d305-5f14-8b5e-85d1274da400 with scrape type 1
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 46f1c2af-d305-5f14-8b5e-85d1274da400
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 46f1c2af-d305-5f14-8b5e-85d1274da400
2026-04-22 13:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 46f1c2af-d305-5f14-8b5e-85d1274da400, identifier: 1674431
2026-04-22 13:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06e3390>
2026-04-22 13:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_6.jpg saved to cache
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_2.jpg not downloaded yet
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_3.jpg not downloaded yet
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-008.jpg not downloaded yet
2026-04-22 13:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 46f1c2af-d305-5f14-8b5e-85d1274da400 with identifier: 1674431
2026-04-22 13:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 46f1c2af-d305-5f14-8b5e-85d1274da400 with identifier: 1674431
2026-04-22 13:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 46f1c2af-d305-5f14-8b5e-85d1274da400 with identifier: 1674431 to the API
2026-04-22 13:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:04 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 46f1c2af-d305-5f14-8b5e-85d1274da400: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:04 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:04 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:04 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '46f1c2af-d305-5f14-8b5e-85d1274da400',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DG67SUA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=1674431',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-09-04',
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 2.0 TDI GT 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI GT 5dr',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:04 [manheim.gb] INFO: Saving data for 1674431: {'created_time': 1776863524.564769, 'last_price_update_time': 1776863524.564781}
2026-04-22 13:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04cd590>
2026-04-22 13:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_1.jpg saved to cache
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8625c0c2-30e0-55d5-8490-1fd89da7281a
2026-04-22 13:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03b7610>
2026-04-22 13:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_9.jpg saved to cache
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3
2026-04-22 13:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd9a4aa6-11dd-5a8e-abf1-7dd8eac2a4b6 with identifier: 1704877
2026-04-22 13:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd9a4aa6-11dd-5a8e-abf1-7dd8eac2a4b6 with scrape type 2
2026-04-22 13:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd9a4aa6-11dd-5a8e-abf1-7dd8eac2a4b6 with scrape type 2
2026-04-22 13:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fd9a4aa6-11dd-5a8e-abf1-7dd8eac2a4b6, identifier: 1704877
2026-04-22 13:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_5.jpg> (referer: None)
2026-04-22 13:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_7.jpg> (referer: None)
2026-04-22 13:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:04 [manheim.gb] INFO: Found listing with ID: 1738314
2026-04-22 13:12:04 [manheim.gb] INFO: Scrape type for 1738314: 1
2026-04-22 13:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fd9a4aa6-11dd-5a8e-abf1-7dd8eac2a4b6 with identifier: 1704877
2026-04-22 13:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fd9a4aa6-11dd-5a8e-abf1-7dd8eac2a4b6 with identifier: 1704877
2026-04-22 13:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: fd9a4aa6-11dd-5a8e-abf1-7dd8eac2a4b6 with identifier: 1704877 to the API
2026-04-22 13:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'fd9a4aa6-11dd-5a8e-abf1-7dd8eac2a4b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'CE64FYO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=1704877',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 62119,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-09-10',
 'seller_name': None,
 'title': 'FIAT 500 1.2 Lounge 3dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.2 Lounge 3dr [Start Stop]',
 'year': 2014}
2026-04-22 13:12:05 [manheim.gb] INFO: Saving data for 1704877: {'created_time': 1776247787.565729, 'last_price_update_time': 1776863525.165307}
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03bacd0>
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_5.jpg saved to cache
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8625c0c2-30e0-55d5-8490-1fd89da7281a
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1195710>
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_2.jpg saved to cache
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3
2026-04-22 13:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_4.jpg> (referer: None)
2026-04-22 13:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_10.jpg> (referer: None)
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_5.jpg not downloaded yet
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-001.jpg not downloaded yet
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05c6d50>
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_1.jpg saved to cache
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0
2026-04-22 13:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baa48e81-d748-5b5a-a902-919f46e2614b with identifier: 1708092
2026-04-22 13:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baa48e81-d748-5b5a-a902-919f46e2614b with scrape type 1
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item baa48e81-d748-5b5a-a902-919f46e2614b
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item baa48e81-d748-5b5a-a902-919f46e2614b
2026-04-22 13:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: baa48e81-d748-5b5a-a902-919f46e2614b, identifier: 1708092
2026-04-22 13:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_7.jpg> (referer: None)
2026-04-22 13:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_11.jpg> (referer: None)
2026-04-22 13:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_4.jpg> (referer: None)
2026-04-22 13:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:05 [manheim.gb] INFO: Found listing with ID: 1741492
2026-04-22 13:12:05 [manheim.gb] INFO: Scrape type for 1741492: 1
2026-04-22 13:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: baa48e81-d748-5b5a-a902-919f46e2614b with identifier: 1708092
2026-04-22 13:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: baa48e81-d748-5b5a-a902-919f46e2614b with identifier: 1708092
2026-04-22 13:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: baa48e81-d748-5b5a-a902-919f46e2614b with identifier: 1708092 to the API
2026-04-22 13:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:05 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id baa48e81-d748-5b5a-a902-919f46e2614b: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:05 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:05 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:05 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester - In Transit',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'baa48e81-d748-5b5a-a902-919f46e2614b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'AE16NJU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=1708092',
 'listing': 'auction',
 'location': 'Manchester - In Transit',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-03-26',
 'seller_name': None,
 'title': 'VAUXHALL CORSA 1.4 [75] ecoFLEX Limited Edition 3dr',
 'transmission': 'manual',
 'trim': '1.4 [75] ecoFLEX Limited Edition 3dr',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:05 [manheim.gb] INFO: Saving data for 1708092: {'created_time': 1776863525.806088, 'last_price_update_time': 1776863525.806099}
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_2.jpg not downloaded yet
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-002.jpg not downloaded yet
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05e0fd0>
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_5.jpg saved to cache
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06be910>
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_7.jpg saved to cache
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1830dce-89f6-5501-aa78-9460a6b30c59
2026-04-22 13:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32f7da02-d72d-5650-abc6-62ad30a3702c with identifier: 1719909
2026-04-22 13:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32f7da02-d72d-5650-abc6-62ad30a3702c with scrape type 1
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32f7da02-d72d-5650-abc6-62ad30a3702c
2026-04-22 13:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1719909-4167002-13.jpg not downloaded yet
2026-04-22 13:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_11.jpg> (referer: None)
2026-04-22 13:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:06 [manheim.gb] INFO: Found listing with ID: 1746652
2026-04-22 13:12:06 [manheim.gb] INFO: Scrape type for 1746652: 0
2026-04-22 13:12:06 [manheim.gb] INFO: Found listing with ID: 1752098
2026-04-22 13:12:06 [manheim.gb] INFO: Scrape type for 1752098: 0
2026-04-22 13:12:06 [manheim.gb] INFO: Found listing with ID: 1755015
2026-04-22 13:12:06 [manheim.gb] INFO: Scrape type for 1755015: 0
2026-04-22 13:12:06 [manheim.gb] INFO: Found listing with ID: 1755823
2026-04-22 13:12:06 [manheim.gb] INFO: Scrape type for 1755823: 1
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fd7990>
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_4.jpg saved to cache
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8625c0c2-30e0-55d5-8490-1fd89da7281a
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b070a110>
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_10.jpg saved to cache
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3
2026-04-22 13:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_4.jpg> (referer: None)
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_9.jpg not downloaded yet
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-003.jpg not downloaded yet
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-012.jpg not downloaded yet
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b15e3bd0>
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_7.jpg saved to cache
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1830dce-89f6-5501-aa78-9460a6b30c59
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1676c90>
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_11.jpg saved to cache
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b188de90>
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_4.jpg saved to cache
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0
2026-04-22 13:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51637c52-11e8-5f08-b89d-60fcb3c89bbe with identifier: 1720405
2026-04-22 13:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe with scrape type 1
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_7.jpg not downloaded yet
2026-04-22 13:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_6.jpg> (referer: None)
2026-04-22 13:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:06 [manheim.gb] INFO: Found listing with ID: 1759683
2026-04-22 13:12:06 [manheim.gb] INFO: Scrape type for 1759683: 1
2026-04-22 13:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_11.jpg> (referer: None)
2026-04-22 13:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_10.jpg> (referer: None)
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_10.jpg not downloaded yet
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-005.jpg not downloaded yet
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-011.jpg not downloaded yet
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_7.jpg not downloaded yet
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1749710>
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_11.jpg saved to cache
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8625c0c2-30e0-55d5-8490-1fd89da7281a
2026-04-22 13:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abadca4f-8110-5793-8452-01bb64ea1b86 with identifier: 1736712
2026-04-22 13:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abadca4f-8110-5793-8452-01bb64ea1b86 with scrape type 1
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item abadca4f-8110-5793-8452-01bb64ea1b86
2026-04-22 13:12:06 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item abadca4f-8110-5793-8452-01bb64ea1b86
2026-04-22 13:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: abadca4f-8110-5793-8452-01bb64ea1b86, identifier: 1736712
2026-04-22 13:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1616203-4166609-13.jpg> (referer: None)
2026-04-22 13:12:06 [manheim.gb] INFO: Found listing with ID: 1761530
2026-04-22 13:12:06 [manheim.gb] INFO: Scrape type for 1761530: 1
2026-04-22 13:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: abadca4f-8110-5793-8452-01bb64ea1b86 with identifier: 1736712
2026-04-22 13:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: abadca4f-8110-5793-8452-01bb64ea1b86 with identifier: 1736712
2026-04-22 13:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: abadca4f-8110-5793-8452-01bb64ea1b86 with identifier: 1736712 to the API
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:07 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id abadca4f-8110-5793-8452-01bb64ea1b86: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:06 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:07 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:07 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Shotts - In Transit',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'abadca4f-8110-5793-8452-01bb64ea1b86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'FL66XMA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/DS/DS%203?id=1736712',
 'listing': 'auction',
 'location': 'Shotts - In Transit',
 'longitude': None,
 'make': 'DS',
 'model': 'DS 3',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-09-30',
 'seller_name': None,
 'title': 'DS DS 3 1.2 PureTech 82 Chic 3dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 82 Chic 3dr',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:07 [manheim.gb] INFO: Saving data for 1736712: {'created_time': 1776863527.102443, 'last_price_update_time': 1776863527.102454}
2026-04-22 13:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05424d0>
2026-04-22 13:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_4.jpg saved to cache
2026-04-22 13:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3
2026-04-22 13:12:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3, skipping ID generation
2026-04-22 13:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3 with scrape type 1
2026-04-22 13:12:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3 sending to next pipeline
2026-04-22 13:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3, identifier: 1559778
2026-04-22 13:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-004.jpg> (referer: None)
2026-04-22 13:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-006.jpg not downloaded yet
2026-04-22 13:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-010.jpg not downloaded yet
2026-04-22 13:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_6.jpg not downloaded yet
2026-04-22 13:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3 with identifier: 1559778
2026-04-22 13:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3 with identifier: 1559778
2026-04-22 13:12:07 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 183bb8a7-49a7-58b1-97f7-b7a9d534d2b3 with identifier: 1559778 to the API
2026-04-22 13:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:07 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham',
 'color': 'Red',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '183bb8a7-49a7-58b1-97f7-b7a9d534d2b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'VK17YLH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MAZDA/CX-3?id=1559778',
 'listing': 'auction',
 'location': 'Birmingham',
 'longitude': None,
 'make': 'MAZDA',
 'model': 'CX-3',
 'odometer': 39404,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319419,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1559778-4169735-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140276,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222420,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209813,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213575,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231821,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145418,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140254,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130777,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_183bb8a7-49a7-58b1-97f7-b7a9d534d2b3/183bb8a7-49a7-58b1-97f7-b7a9d534d2b3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140052,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0534e15e-8fb6-4a0d-9e15-0d40df3181b5_4.jpg',
             'Width': 1500}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-05-10',
 'seller_name': None,
 'title': 'MAZDA CX-3 2.0 Sport Nav 5dr',
 'transmission': 'manual',
 'trim': '2.0 Sport Nav 5dr',
 'year': 2017}
2026-04-22 13:12:07 [manheim.gb] INFO: Saving data for 1559778: {'created_time': 1776863527.817361, 'last_price_update_time': 1776863527.817374}
2026-04-22 13:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1651581-4169581-13.jpg> (referer: None)
2026-04-22 13:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:07 [manheim.gb] INFO: Found listing with ID: 1774877
2026-04-22 13:12:07 [manheim.gb] INFO: Scrape type for 1774877: 0
2026-04-22 13:12:07 [manheim.gb] INFO: Found listing with ID: 1775276
2026-04-22 13:12:07 [manheim.gb] INFO: Scrape type for 1775276: 1
2026-04-22 13:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06ae6d0>
2026-04-22 13:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_6.jpg saved to cache
2026-04-22 13:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1830dce-89f6-5501-aa78-9460a6b30c59
2026-04-22 13:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ce24a64-137e-587b-9b33-2a91884b2f12 with identifier: 1738314
2026-04-22 13:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce24a64-137e-587b-9b33-2a91884b2f12 with scrape type 1
2026-04-22 13:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3ce24a64-137e-587b-9b33-2a91884b2f12
2026-04-22 13:12:07 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3ce24a64-137e-587b-9b33-2a91884b2f12
2026-04-22 13:12:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3ce24a64-137e-587b-9b33-2a91884b2f12, identifier: 1738314
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06a1c50>
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_11.jpg saved to cache
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0610f50>
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_10.jpg saved to cache
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0
2026-04-22 13:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_4.jpg> (referer: None)
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-007.jpg not downloaded yet
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-009.jpg not downloaded yet
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_1.jpg not downloaded yet
2026-04-22 13:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3ce24a64-137e-587b-9b33-2a91884b2f12 with identifier: 1738314
2026-04-22 13:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3ce24a64-137e-587b-9b33-2a91884b2f12 with identifier: 1738314
2026-04-22 13:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 3ce24a64-137e-587b-9b33-2a91884b2f12 with identifier: 1738314 to the API
2026-04-22 13:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '3ce24a64-137e-587b-9b33-2a91884b2f12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'SD64YZM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=1738314',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 55597,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-10-27',
 'seller_name': None,
 'title': 'FIAT 500 1.2 Lounge 3dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.2 Lounge 3dr [Start Stop]',
 'year': 2014}
2026-04-22 13:12:08 [manheim.gb] INFO: Saving data for 1738314: {'created_time': 1776863528.515597, 'last_price_update_time': 1776863528.51561}
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b070bd10>
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1616203-4166609-13.jpg saved to cache
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1830dce-89f6-5501-aa78-9460a6b30c59
2026-04-22 13:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-008.jpg> (referer: None)
2026-04-22 13:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_3.jpg> (referer: None)
2026-04-22 13:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:08 [manheim.gb] INFO: Found listing with ID: 1776334
2026-04-22 13:12:08 [manheim.gb] INFO: Scrape type for 1776334: 0
2026-04-22 13:12:08 [manheim.gb] INFO: Found listing with ID: 1783808
2026-04-22 13:12:08 [manheim.gb] INFO: Scrape type for 1783808: 1
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b19f46d0>
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-004.jpg saved to cache
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77
2026-04-22 13:12:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff02dd7c-ef49-524b-aa0d-3b3567ca94dc with identifier: 1741492
2026-04-22 13:12:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff02dd7c-ef49-524b-aa0d-3b3567ca94dc with scrape type 1
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ff02dd7c-ef49-524b-aa0d-3b3567ca94dc
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ff02dd7c-ef49-524b-aa0d-3b3567ca94dc
2026-04-22 13:12:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ff02dd7c-ef49-524b-aa0d-3b3567ca94dc, identifier: 1741492
2026-04-22 13:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_9.jpg> (referer: None)
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-009.jpg not downloaded yet
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-007.jpg not downloaded yet
2026-04-22 13:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_5.jpg not downloaded yet
2026-04-22 13:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ff02dd7c-ef49-524b-aa0d-3b3567ca94dc with identifier: 1741492
2026-04-22 13:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ff02dd7c-ef49-524b-aa0d-3b3567ca94dc with identifier: 1741492
2026-04-22 13:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ff02dd7c-ef49-524b-aa0d-3b3567ca94dc with identifier: 1741492 to the API
2026-04-22 13:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'ff02dd7c-ef49-524b-aa0d-3b3567ca94dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'SK65NDY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=1741492',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 68411,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-09-08',
 'seller_name': None,
 'title': 'VAUXHALL CORSA 1.2 Sting 3dr',
 'transmission': 'manual',
 'trim': '1.2 Sting 3dr',
 'year': 2015}
2026-04-22 13:12:09 [manheim.gb] INFO: Saving data for 1741492: {'created_time': 1776863529.237238, 'last_price_update_time': 1776863529.237248}
2026-04-22 13:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fd8fd0>
2026-04-22 13:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1651581-4169581-13.jpg saved to cache
2026-04-22 13:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77
2026-04-22 13:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 145ef02e-829b-5f79-9a61-6df0ba93c54a with identifier: 1755823
2026-04-22 13:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 145ef02e-829b-5f79-9a61-6df0ba93c54a with scrape type 1
2026-04-22 13:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 145ef02e-829b-5f79-9a61-6df0ba93c54a
2026-04-22 13:12:09 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 145ef02e-829b-5f79-9a61-6df0ba93c54a
2026-04-22 13:12:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 145ef02e-829b-5f79-9a61-6df0ba93c54a, identifier: 1755823
2026-04-22 13:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_2.jpg> (referer: None)
2026-04-22 13:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_2.jpg> (referer: None)
2026-04-22 13:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:09 [manheim.gb] INFO: Found listing with ID: 1791162
2026-04-22 13:12:09 [manheim.gb] INFO: Scrape type for 1791162: 0
2026-04-22 13:12:09 [manheim.gb] INFO: Found listing with ID: 1792116
2026-04-22 13:12:09 [manheim.gb] INFO: Scrape type for 1792116: 0
2026-04-22 13:12:09 [manheim.gb] INFO: Found listing with ID: 1794303
2026-04-22 13:12:09 [manheim.gb] INFO: Scrape type for 1794303: 0
2026-04-22 13:12:09 [manheim.gb] INFO: Found listing with ID: 1795923
2026-04-22 13:12:09 [manheim.gb] INFO: Scrape type for 1795923: 0
2026-04-22 13:12:09 [manheim.gb] INFO: Found listing with ID: 1804173
2026-04-22 13:12:09 [manheim.gb] INFO: Scrape type for 1804173: 1
2026-04-22 13:12:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 145ef02e-829b-5f79-9a61-6df0ba93c54a with identifier: 1755823
2026-04-22 13:12:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 145ef02e-829b-5f79-9a61-6df0ba93c54a with identifier: 1755823
2026-04-22 13:12:09 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 145ef02e-829b-5f79-9a61-6df0ba93c54a with identifier: 1755823 to the API
2026-04-22 13:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '145ef02e-829b-5f79-9a61-6df0ba93c54a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'GD14FYR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ZAFIRA?id=1755823',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'ZAFIRA',
 'odometer': 90121,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'VAUXHALL ZAFIRA 2.0 CDTi SRi 5dr',
 'transmission': 'manual',
 'trim': '2.0 CDTi SRi 5dr',
 'year': 2014}
2026-04-22 13:12:09 [manheim.gb] INFO: Saving data for 1755823: {'created_time': 1776863529.87461, 'last_price_update_time': 1776863529.874623}
2026-04-22 13:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0556850>
2026-04-22 13:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_4.jpg saved to cache
2026-04-22 13:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1830dce-89f6-5501-aa78-9460a6b30c59
2026-04-22 13:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-006.jpg not downloaded yet
2026-04-22 13:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_4.jpg not downloaded yet
2026-04-22 13:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04be290>
2026-04-22 13:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-008.jpg saved to cache
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04fa210>
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_3.jpg saved to cache
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1830dce-89f6-5501-aa78-9460a6b30c59
2026-04-22 13:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02d567fd-d125-5b78-8bfd-adafcae7b165 with identifier: 1759683
2026-04-22 13:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02d567fd-d125-5b78-8bfd-adafcae7b165 with scrape type 1
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 02d567fd-d125-5b78-8bfd-adafcae7b165
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1759683-4168512-3.jpg not downloaded yet
2026-04-22 13:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-001.jpg> (referer: None)
2026-04-22 13:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:10 [manheim.gb] INFO: Found listing with ID: 1805138
2026-04-22 13:12:10 [manheim.gb] INFO: Scrape type for 1805138: 0
2026-04-22 13:12:10 [manheim.gb] INFO: Found listing with ID: 1807188
2026-04-22 13:12:10 [manheim.gb] INFO: Scrape type for 1807188: 1
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04f7790>
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_9.jpg saved to cache
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0
2026-04-22 13:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-002.jpg> (referer: None)
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-005.jpg not downloaded yet
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_11.jpg not downloaded yet
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1759683-4168512-13.jpg not downloaded yet
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b057ba90>
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_2.jpg saved to cache
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0
2026-04-22 13:12:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0, skipping ID generation
2026-04-22 13:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0 with scrape type 1
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0 sending to next pipeline
2026-04-22 13:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0, identifier: 1589560
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2b3ca10>
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_2.jpg saved to cache
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8625c0c2-30e0-55d5-8490-1fd89da7281a
2026-04-22 13:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fde89091-e9a9-5093-94a1-9bf9c55417fd with identifier: 1761530
2026-04-22 13:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fde89091-e9a9-5093-94a1-9bf9c55417fd with scrape type 1
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item fde89091-e9a9-5093-94a1-9bf9c55417fd
2026-04-22 13:12:10 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item fde89091-e9a9-5093-94a1-9bf9c55417fd
2026-04-22 13:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fde89091-e9a9-5093-94a1-9bf9c55417fd, identifier: 1761530
2026-04-22 13:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1719909-4167002-13.jpg> (referer: None)
2026-04-22 13:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-012.jpg> (referer: None)
2026-04-22 13:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_7.jpg> (referer: None)
2026-04-22 13:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:10 [manheim.gb] INFO: Found listing with ID: 1821322
2026-04-22 13:12:10 [manheim.gb] INFO: Scrape type for 1821322: 0
2026-04-22 13:12:10 [manheim.gb] INFO: Found listing with ID: 1827359
2026-04-22 13:12:10 [manheim.gb] INFO: Scrape type for 1827359: 0
2026-04-22 13:12:10 [manheim.gb] INFO: Found listing with ID: 1831926
2026-04-22 13:12:10 [manheim.gb] INFO: Scrape type for 1831926: 0
2026-04-22 13:12:10 [manheim.gb] INFO: Found listing with ID: 1835546
2026-04-22 13:12:10 [manheim.gb] INFO: Scrape type for 1835546: 1
2026-04-22 13:12:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0 with identifier: 1589560
2026-04-22 13:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0 with identifier: 1589560
2026-04-22 13:12:10 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0 with identifier: 1589560 to the API
2026-04-22 13:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WA16WEH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=1589560',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 80070,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234502,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234502,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262585,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312157,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206780,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182065,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205104,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189033,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202499,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0/dc1cd4ec-6b89-54f6-826b-5fb1ec7f6ab0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293670,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/764dfde7-5c1f-448c-927f-c5e1cea89de5_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-03-30',
 'seller_name': None,
 'title': 'MINI HATCHBACK 1.5 Cooper D 5dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper D 5dr',
 'year': 2016}
2026-04-22 13:12:11 [manheim.gb] INFO: Saving data for 1589560: {'created_time': 1776863531.036299, 'last_price_update_time': 1776863531.03631}
2026-04-22 13:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fde89091-e9a9-5093-94a1-9bf9c55417fd with identifier: 1761530
2026-04-22 13:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fde89091-e9a9-5093-94a1-9bf9c55417fd with identifier: 1761530
2026-04-22 13:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: fde89091-e9a9-5093-94a1-9bf9c55417fd with identifier: 1761530 to the API
2026-04-22 13:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester - In Transit',
 'color': 'Grey',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'fde89091-e9a9-5093-94a1-9bf9c55417fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BF65AYL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/DS/DS%203?id=1761530',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'longitude': None,
 'make': 'DS',
 'model': 'DS 3',
 'odometer': 108252,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-02-17',
 'seller_name': None,
 'title': 'DS DS 3 1.6 BlueHDi 120 DStyle 3dr',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi 120 DStyle 3dr',
 'year': 2016}
2026-04-22 13:12:11 [manheim.gb] INFO: Saving data for 1761530: {'created_time': 1776863531.473254, 'last_price_update_time': 1776863531.473265}
2026-04-22 13:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_7.jpg> (referer: None)
2026-04-22 13:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-011.jpg> (referer: None)
2026-04-22 13:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-003.jpg not downloaded yet
2026-04-22 13:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_10.jpg not downloaded yet
2026-04-22 13:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:11 [manheim.gb] INFO: Found listing with ID: 1843647
2026-04-22 13:12:11 [manheim.gb] INFO: Scrape type for 1843647: 0
2026-04-22 13:12:11 [manheim.gb] INFO: Found listing with ID: 1856672
2026-04-22 13:12:11 [manheim.gb] INFO: Scrape type for 1856672: 1
2026-04-22 13:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06124d0>
2026-04-22 13:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-001.jpg saved to cache
2026-04-22 13:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77
2026-04-22 13:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93db4566-4c98-5ff7-b2f1-7aee00db58df with identifier: 1775276
2026-04-22 13:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93db4566-4c98-5ff7-b2f1-7aee00db58df with scrape type 1
2026-04-22 13:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 93db4566-4c98-5ff7-b2f1-7aee00db58df
2026-04-22 13:12:11 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 93db4566-4c98-5ff7-b2f1-7aee00db58df
2026-04-22 13:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 93db4566-4c98-5ff7-b2f1-7aee00db58df, identifier: 1775276
2026-04-22 13:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b068c610>
2026-04-22 13:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-002.jpg saved to cache
2026-04-22 13:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77
2026-04-22 13:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-005.jpg> (referer: None)
2026-04-22 13:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-002.jpg not downloaded yet
2026-04-22 13:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_9.jpg not downloaded yet
2026-04-22 13:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 93db4566-4c98-5ff7-b2f1-7aee00db58df with identifier: 1775276
2026-04-22 13:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 93db4566-4c98-5ff7-b2f1-7aee00db58df with identifier: 1775276
2026-04-22 13:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 93db4566-4c98-5ff7-b2f1-7aee00db58df with identifier: 1775276 to the API
2026-04-22 13:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '93db4566-4c98-5ff7-b2f1-7aee00db58df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'PK67ZDZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/MERIVA?id=1775276',
 'listing': 'auction',
 'location': 'Washington',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'MERIVA',
 'odometer': 73854,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-10-30',
 'seller_name': None,
 'title': 'VAUXHALL MERIVA 1.4i 16V Life 5dr',
 'transmission': 'manual',
 'trim': '1.4i 16V Life 5dr',
 'year': 2017}
2026-04-22 13:12:12 [manheim.gb] INFO: Saving data for 1775276: {'created_time': 1776863532.164354, 'last_price_update_time': 1776863532.164366}
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05446d0>
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1719909-4167002-13.jpg saved to cache
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32f7da02-d72d-5650-abc6-62ad30a3702c
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05d3f90>
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-012.jpg saved to cache
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32f7da02-d72d-5650-abc6-62ad30a3702c
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0779750>
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_7.jpg saved to cache
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe
2026-04-22 13:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce97f1d2-09fd-53c6-8e59-eed1bbdd938f with identifier: 1783808
2026-04-22 13:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce97f1d2-09fd-53c6-8e59-eed1bbdd938f with scrape type 1
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ce97f1d2-09fd-53c6-8e59-eed1bbdd938f
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ce97f1d2-09fd-53c6-8e59-eed1bbdd938f
2026-04-22 13:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ce97f1d2-09fd-53c6-8e59-eed1bbdd938f, identifier: 1783808
2026-04-22 13:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:12 [manheim.gb] INFO: Found listing with ID: 1859310
2026-04-22 13:12:12 [manheim.gb] INFO: Scrape type for 1859310: 1
2026-04-22 13:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ce97f1d2-09fd-53c6-8e59-eed1bbdd938f with identifier: 1783808
2026-04-22 13:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ce97f1d2-09fd-53c6-8e59-eed1bbdd938f with identifier: 1783808
2026-04-22 13:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ce97f1d2-09fd-53c6-8e59-eed1bbdd938f with identifier: 1783808 to the API
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:12 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id ce97f1d2-09fd-53c6-8e59-eed1bbdd938f: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:12 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:12 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:12 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington - In Transit',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'ce97f1d2-09fd-53c6-8e59-eed1bbdd938f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'HV65ZKG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=1783808',
 'listing': 'auction',
 'location': 'Washington - In Transit',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': '108',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-11-05',
 'seller_name': None,
 'title': 'PEUGEOT 108 1.2 PureTech Allure 3dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure 3dr',
 'year': 2015}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:12 [manheim.gb] INFO: Saving data for 1783808: {'created_time': 1776863532.735745, 'last_price_update_time': 1776863532.735756}
2026-04-22 13:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_6.jpg> (referer: None)
2026-04-22 13:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-010.jpg> (referer: None)
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_2.jpg not downloaded yet
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1038e50>
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_7.jpg saved to cache
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06bd950>
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-011.jpg saved to cache
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32f7da02-d72d-5650-abc6-62ad30a3702c
2026-04-22 13:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbfac648-394b-55bf-8937-9df838a53d61 with identifier: 1804173
2026-04-22 13:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbfac648-394b-55bf-8937-9df838a53d61 with scrape type 1
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbfac648-394b-55bf-8937-9df838a53d61
2026-04-22 13:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-004.jpg not downloaded yet
2026-04-22 13:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_1.jpg> (referer: None)
2026-04-22 13:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:12 [manheim.gb] INFO: Found listing with ID: 1867909
2026-04-22 13:12:12 [manheim.gb] INFO: Scrape type for 1867909: 1
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1729a50>
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-005.jpg saved to cache
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77
2026-04-22 13:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-006.jpg> (referer: None)
2026-04-22 13:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_5.jpg> (referer: None)
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-008.jpg not downloaded yet
2026-04-22 13:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9486aea-a20c-5c5e-8ec9-aa40d98a01fc with identifier: 1807188
2026-04-22 13:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9486aea-a20c-5c5e-8ec9-aa40d98a01fc with scrape type 1
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e9486aea-a20c-5c5e-8ec9-aa40d98a01fc
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e9486aea-a20c-5c5e-8ec9-aa40d98a01fc
2026-04-22 13:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e9486aea-a20c-5c5e-8ec9-aa40d98a01fc, identifier: 1807188
2026-04-22 13:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-007.jpg> (referer: None)
2026-04-22 13:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-009.jpg> (referer: None)
2026-04-22 13:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:13 [manheim.gb] INFO: Found listing with ID: 1880115
2026-04-22 13:12:13 [manheim.gb] INFO: Scrape type for 1880115: 0
2026-04-22 13:12:13 [manheim.gb] INFO: Found listing with ID: 1888432
2026-04-22 13:12:13 [manheim.gb] INFO: Scrape type for 1888432: 0
2026-04-22 13:12:13 [manheim.gb] INFO: Found listing with ID: 1888802
2026-04-22 13:12:13 [manheim.gb] INFO: Scrape type for 1888802: 0
2026-04-22 13:12:13 [manheim.gb] INFO: Found listing with ID: 1899227
2026-04-22 13:12:13 [manheim.gb] INFO: Scrape type for 1899227: 1
2026-04-22 13:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e9486aea-a20c-5c5e-8ec9-aa40d98a01fc with identifier: 1807188
2026-04-22 13:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e9486aea-a20c-5c5e-8ec9-aa40d98a01fc with identifier: 1807188
2026-04-22 13:12:13 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e9486aea-a20c-5c5e-8ec9-aa40d98a01fc with identifier: 1807188 to the API
2026-04-22 13:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:13 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id e9486aea-a20c-5c5e-8ec9-aa40d98a01fc: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:13 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:13 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:13 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'e9486aea-a20c-5c5e-8ec9-aa40d98a01fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KU67XUW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/GL?id=1807188',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GL',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-09-12',
 'seller_name': None,
 'title': 'MERCEDES-BENZ GL GLA 220d 4Matic AMG Line Prem Plus 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 220d 4Matic AMG Line Prem Plus 5dr Auto',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:13 [manheim.gb] INFO: Saving data for 1807188: {'created_time': 1776863533.544728, 'last_price_update_time': 1776863533.544739}
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1686910>
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_6.jpg saved to cache
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14c5450>
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-010.jpg saved to cache
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32f7da02-d72d-5650-abc6-62ad30a3702c
2026-04-22 13:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1759683-4168512-3.jpg> (referer: None)
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-001.jpg not downloaded yet
2026-04-22 13:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:13 [manheim.gb] INFO: Found listing with ID: 1899704
2026-04-22 13:12:13 [manheim.gb] INFO: Scrape type for 1899704: 1
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05024d0>
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_1.jpg saved to cache
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe
2026-04-22 13:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26aa741b-06b0-5037-9c0d-b34e5ce5b2b1 with identifier: 1835546
2026-04-22 13:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26aa741b-06b0-5037-9c0d-b34e5ce5b2b1 with scrape type 1
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 26aa741b-06b0-5037-9c0d-b34e5ce5b2b1
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 26aa741b-06b0-5037-9c0d-b34e5ce5b2b1
2026-04-22 13:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 26aa741b-06b0-5037-9c0d-b34e5ce5b2b1, identifier: 1835546
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1684310>
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-006.jpg saved to cache
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14a3b50>
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_5.jpg saved to cache
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe
2026-04-22 13:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-002.jpg not downloaded yet
2026-04-22 13:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 26aa741b-06b0-5037-9c0d-b34e5ce5b2b1 with identifier: 1835546
2026-04-22 13:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 26aa741b-06b0-5037-9c0d-b34e5ce5b2b1 with identifier: 1835546
2026-04-22 13:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 26aa741b-06b0-5037-9c0d-b34e5ce5b2b1 with identifier: 1835546 to the API
2026-04-22 13:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '26aa741b-06b0-5037-9c0d-b34e5ce5b2b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'RO11RTX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=1835546',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 113498,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2011-04-11',
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 1.6 TDi 105 Match 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDi 105 Match 5dr',
 'year': 2011}
2026-04-22 13:12:14 [manheim.gb] INFO: Saving data for 1835546: {'created_time': 1776863534.269269, 'last_price_update_time': 1776863534.269282}
2026-04-22 13:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16f0710>
2026-04-22 13:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-007.jpg saved to cache
2026-04-22 13:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77
2026-04-22 13:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0510550>
2026-04-22 13:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-009.jpg saved to cache
2026-04-22 13:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32f7da02-d72d-5650-abc6-62ad30a3702c
2026-04-22 13:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f36b7bde-9995-5be6-bcd7-d356a6ffb1db with identifier: 1856672
2026-04-22 13:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36b7bde-9995-5be6-bcd7-d356a6ffb1db with scrape type 1
2026-04-22 13:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f36b7bde-9995-5be6-bcd7-d356a6ffb1db
2026-04-22 13:12:14 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f36b7bde-9995-5be6-bcd7-d356a6ffb1db
2026-04-22 13:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f36b7bde-9995-5be6-bcd7-d356a6ffb1db, identifier: 1856672
2026-04-22 13:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-006.jpg> (referer: None)
2026-04-22 13:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_4.jpg> (referer: None)
2026-04-22 13:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:14 [manheim.gb] INFO: Found listing with ID: 1900190
2026-04-22 13:12:14 [manheim.gb] INFO: Scrape type for 1900190: 0
2026-04-22 13:12:14 [manheim.gb] INFO: Found listing with ID: 190944
2026-04-22 13:12:14 [manheim.gb] INFO: Scrape type for 190944: 1
2026-04-22 13:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f36b7bde-9995-5be6-bcd7-d356a6ffb1db with identifier: 1856672
2026-04-22 13:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:12:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREEN HTTP/1.1" 200 None
2026-04-22 13:12:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f36b7bde-9995-5be6-bcd7-d356a6ffb1db with identifier: 1856672
2026-04-22 13:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f36b7bde-9995-5be6-bcd7-d356a6ffb1db with identifier: 1856672 to the API
2026-04-22 13:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:14 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id f36b7bde-9995-5be6-bcd7-d356a6ffb1db: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:14 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:14 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:14 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'GREEN',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'f36b7bde-9995-5be6-bcd7-d356a6ffb1db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KS65CCK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=1856672',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-12-30',
 'seller_name': None,
 'title': 'MINI HATCHBACK 1.5 Cooper D 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 Cooper D 5dr Auto',
 'year': 2015}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:14 [manheim.gb] INFO: Saving data for 1856672: {'created_time': 1776863534.984004, 'last_price_update_time': 1776863534.984015}
2026-04-22 13:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_11.jpg> (referer: None)
2026-04-22 13:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-003.jpg not downloaded yet
2026-04-22 13:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0522f90>
2026-04-22 13:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02d567fd-d125-5b78-8bfd-adafcae7b165/02d567fd-d125-5b78-8bfd-adafcae7b165_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1759683-4168512-3.jpg saved to cache
2026-04-22 13:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02d567fd-d125-5b78-8bfd-adafcae7b165
2026-04-22 13:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f17c9a9-bccd-5eef-933c-5783252804a5 with identifier: 1859310
2026-04-22 13:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f17c9a9-bccd-5eef-933c-5783252804a5 with scrape type 1
2026-04-22 13:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 9f17c9a9-bccd-5eef-933c-5783252804a5
2026-04-22 13:12:15 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 9f17c9a9-bccd-5eef-933c-5783252804a5
2026-04-22 13:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9f17c9a9-bccd-5eef-933c-5783252804a5, identifier: 1859310
2026-04-22 13:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-007.jpg> (referer: None)
2026-04-22 13:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:15 [manheim.gb] INFO: Found listing with ID: 1925257
2026-04-22 13:12:15 [manheim.gb] INFO: Scrape type for 1925257: 0
2026-04-22 13:12:15 [manheim.gb] INFO: Found listing with ID: 1929825
2026-04-22 13:12:15 [manheim.gb] INFO: Scrape type for 1929825: 0
2026-04-22 13:12:15 [manheim.gb] INFO: Found listing with ID: 1930372
2026-04-22 13:12:15 [manheim.gb] INFO: Scrape type for 1930372: 0
2026-04-22 13:12:15 [manheim.gb] INFO: Found listing with ID: 1930763
2026-04-22 13:12:15 [manheim.gb] INFO: Scrape type for 1930763: 0
2026-04-22 13:12:15 [manheim.gb] INFO: Found listing with ID: 1935405
2026-04-22 13:12:15 [manheim.gb] INFO: Scrape type for 1935405: 0
2026-04-22 13:12:15 [manheim.gb] INFO: Found listing with ID: 1936916
2026-04-22 13:12:15 [manheim.gb] INFO: Scrape type for 1936916: 0
2026-04-22 13:12:15 [manheim.gb] INFO: Found listing with ID: 1938753
2026-04-22 13:12:15 [manheim.gb] INFO: Scrape type for 1938753: 0
2026-04-22 13:12:15 [manheim.gb] INFO: Found listing with ID: 1939917
2026-04-22 13:12:15 [manheim.gb] INFO: Scrape type for 1939917: 1
2026-04-22 13:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9f17c9a9-bccd-5eef-933c-5783252804a5 with identifier: 1859310
2026-04-22 13:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9f17c9a9-bccd-5eef-933c-5783252804a5 with identifier: 1859310
2026-04-22 13:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9f17c9a9-bccd-5eef-933c-5783252804a5 with identifier: 1859310 to the API
2026-04-22 13:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '9f17c9a9-bccd-5eef-933c-5783252804a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'HW15KAA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SEAT/LEON?id=1859310',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 96658,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-08-24',
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 184 FR 5dr [Technology Pack]',
 'transmission': 'manual',
 'trim': '2.0 TDI 184 FR 5dr [Technology Pack]',
 'year': 2015}
2026-04-22 13:12:15 [manheim.gb] INFO: Saving data for 1859310: {'created_time': 1776863535.742757, 'last_price_update_time': 1776863535.742769}
2026-04-22 13:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_10.jpg> (referer: None)
2026-04-22 13:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_9.jpg> (referer: None)
2026-04-22 13:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-005.jpg not downloaded yet
2026-04-22 13:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0649a50>
2026-04-22 13:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-006.jpg saved to cache
2026-04-22 13:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 32f7da02-d72d-5650-abc6-62ad30a3702c
2026-04-22 13:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0629390>
2026-04-22 13:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_4.jpg saved to cache
2026-04-22 13:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe
2026-04-22 13:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ae8c2f-79f0-572c-91fe-66d726e7ee2e with identifier: 1867909
2026-04-22 13:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ae8c2f-79f0-572c-91fe-66d726e7ee2e with scrape type 1
2026-04-22 13:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 20ae8c2f-79f0-572c-91fe-66d726e7ee2e
2026-04-22 13:12:15 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 20ae8c2f-79f0-572c-91fe-66d726e7ee2e
2026-04-22 13:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 20ae8c2f-79f0-572c-91fe-66d726e7ee2e, identifier: 1867909
2026-04-22 13:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-002.jpg> (referer: None)
2026-04-22 13:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:15 [manheim.gb] INFO: Found listing with ID: 1943843
2026-04-22 13:12:16 [manheim.gb] INFO: Scrape type for 1943843: 1
2026-04-22 13:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 20ae8c2f-79f0-572c-91fe-66d726e7ee2e with identifier: 1867909
2026-04-22 13:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 20ae8c2f-79f0-572c-91fe-66d726e7ee2e with identifier: 1867909
2026-04-22 13:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 20ae8c2f-79f0-572c-91fe-66d726e7ee2e with identifier: 1867909 to the API
2026-04-22 13:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:16 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 20ae8c2f-79f0-572c-91fe-66d726e7ee2e: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:15 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:16 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:16 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '20ae8c2f-79f0-572c-91fe-66d726e7ee2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'PJ14RWF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MAZDA/3?id=1867909',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'MAZDA',
 'model': '3',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-06-25',
 'seller_name': None,
 'title': 'MAZDA 3 2.0 Sport Nav 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 Sport Nav 5dr Auto',
 'year': 2014}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:16 [manheim.gb] INFO: Saving data for 1867909: {'created_time': 1776863536.29729, 'last_price_update_time': 1776863536.297304}
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b061ff90>
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_11.jpg saved to cache
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe
2026-04-22 13:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1759683-4168512-13.jpg> (referer: None)
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-006.jpg not downloaded yet
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0675f10>
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-007.jpg saved to cache
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 32f7da02-d72d-5650-abc6-62ad30a3702c
2026-04-22 13:12:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 081dd353-b90b-5e7a-9240-ed48f668cfad with identifier: 1899227
2026-04-22 13:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 081dd353-b90b-5e7a-9240-ed48f668cfad with scrape type 1
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 081dd353-b90b-5e7a-9240-ed48f668cfad
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_7.jpg not downloaded yet
2026-04-22 13:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-003.jpg> (referer: None)
2026-04-22 13:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:16 [manheim.gb] INFO: Found listing with ID: 1944953
2026-04-22 13:12:16 [manheim.gb] INFO: Scrape type for 1944953: 0
2026-04-22 13:12:16 [manheim.gb] INFO: Found listing with ID: 1946933
2026-04-22 13:12:16 [manheim.gb] INFO: Scrape type for 1946933: 0
2026-04-22 13:12:16 [manheim.gb] INFO: Found listing with ID: 1947598
2026-04-22 13:12:16 [manheim.gb] INFO: Scrape type for 1947598: 0
2026-04-22 13:12:16 [manheim.gb] INFO: Found listing with ID: 1952234
2026-04-22 13:12:16 [manheim.gb] INFO: Scrape type for 1952234: 0
2026-04-22 13:12:16 [manheim.gb] INFO: Found listing with ID: 1957654
2026-04-22 13:12:16 [manheim.gb] INFO: Scrape type for 1957654: 0
2026-04-22 13:12:16 [manheim.gb] INFO: Found listing with ID: 1958437
2026-04-22 13:12:16 [manheim.gb] INFO: Scrape type for 1958437: 0
2026-04-22 13:12:16 [manheim.gb] INFO: Found listing with ID: 1966016
2026-04-22 13:12:16 [manheim.gb] INFO: Scrape type for 1966016: 0
2026-04-22 13:12:16 [manheim.gb] INFO: Found listing with ID: 1971707
2026-04-22 13:12:16 [manheim.gb] INFO: Scrape type for 1971707: 1
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1739490>
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_10.jpg saved to cache
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06be9d0>
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_9.jpg saved to cache
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-007.jpg not downloaded yet
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_7.jpg not downloaded yet
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04db010>
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-002.jpg saved to cache
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 32f7da02-d72d-5650-abc6-62ad30a3702c
2026-04-22 13:12:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ddd769f-04cb-519b-9269-1f9be20f224b with identifier: 1899704
2026-04-22 13:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ddd769f-04cb-519b-9269-1f9be20f224b with scrape type 1
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2ddd769f-04cb-519b-9269-1f9be20f224b
2026-04-22 13:12:16 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2ddd769f-04cb-519b-9269-1f9be20f224b
2026-04-22 13:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2ddd769f-04cb-519b-9269-1f9be20f224b, identifier: 1899704
2026-04-22 13:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_2.jpg> (referer: None)
2026-04-22 13:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:16 [manheim.gb] INFO: Found listing with ID: 1975199
2026-04-22 13:12:16 [manheim.gb] INFO: Scrape type for 1975199: 0
2026-04-22 13:12:16 [manheim.gb] INFO: Found listing with ID: 1981962
2026-04-22 13:12:16 [manheim.gb] INFO: Scrape type for 1981962: 0
2026-04-22 13:12:16 [manheim.gb] INFO: Found listing with ID: 1982398
2026-04-22 13:12:16 [manheim.gb] INFO: Scrape type for 1982398: 0
2026-04-22 13:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2ddd769f-04cb-519b-9269-1f9be20f224b with identifier: 1899704
2026-04-22 13:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2ddd769f-04cb-519b-9269-1f9be20f224b with identifier: 1899704
2026-04-22 13:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 2ddd769f-04cb-519b-9269-1f9be20f224b with identifier: 1899704 to the API
2026-04-22 13:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '2ddd769f-04cb-519b-9269-1f9be20f224b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'MJ66DZT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SEAT/LEON?id=1899704',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 67140,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-01-08',
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TSI Cupra Black 290 3dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TSI Cupra Black 290 3dr DSG',
 'year': 2017}
2026-04-22 13:12:17 [manheim.gb] INFO: Saving data for 1899704: {'created_time': 1776863537.3109, 'last_price_update_time': 1776863537.310912}
2026-04-22 13:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-005.jpg> (referer: None)
2026-04-22 13:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-009.jpg not downloaded yet
2026-04-22 13:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_6.jpg not downloaded yet
2026-04-22 13:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0502110>
2026-04-22 13:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02d567fd-d125-5b78-8bfd-adafcae7b165/02d567fd-d125-5b78-8bfd-adafcae7b165_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1759683-4168512-13.jpg saved to cache
2026-04-22 13:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02d567fd-d125-5b78-8bfd-adafcae7b165
2026-04-22 13:12:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02d567fd-d125-5b78-8bfd-adafcae7b165, skipping ID generation
2026-04-22 13:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02d567fd-d125-5b78-8bfd-adafcae7b165 with scrape type 1
2026-04-22 13:12:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02d567fd-d125-5b78-8bfd-adafcae7b165 sending to next pipeline
2026-04-22 13:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 02d567fd-d125-5b78-8bfd-adafcae7b165, identifier: 1759683
2026-04-22 13:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b101bb50>
2026-04-22 13:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-003.jpg saved to cache
2026-04-22 13:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 32f7da02-d72d-5650-abc6-62ad30a3702c
2026-04-22 13:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c098cd70-4a96-5790-8b6b-88a2e27644af with identifier: 190944
2026-04-22 13:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c098cd70-4a96-5790-8b6b-88a2e27644af with scrape type 1
2026-04-22 13:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item c098cd70-4a96-5790-8b6b-88a2e27644af
2026-04-22 13:12:17 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item c098cd70-4a96-5790-8b6b-88a2e27644af
2026-04-22 13:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c098cd70-4a96-5790-8b6b-88a2e27644af, identifier: 190944
2026-04-22 13:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-009.jpg> (referer: None)
2026-04-22 13:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-008.jpg> (referer: None)
2026-04-22 13:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 02d567fd-d125-5b78-8bfd-adafcae7b165 with identifier: 1759683
2026-04-22 13:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 02d567fd-d125-5b78-8bfd-adafcae7b165 with identifier: 1759683
2026-04-22 13:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 02d567fd-d125-5b78-8bfd-adafcae7b165 with identifier: 1759683 to the API
2026-04-22 13:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-1759683-4168512-13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '02d567fd-d125-5b78-8bfd-adafcae7b165',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YA65CPZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1759683',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 82658,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_410ff630-6543-5547-ae72-a20ded1fd770/410ff630-6543-5547-ae72-a20ded1fd770_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_410ff630-6543-5547-ae72-a20ded1fd770/410ff630-6543-5547-ae72-a20ded1fd770_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_02d567fd-d125-5b78-8bfd-adafcae7b165/02d567fd-d125-5b78-8bfd-adafcae7b165_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226046,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1759683-4168512-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_02d567fd-d125-5b78-8bfd-adafcae7b165/02d567fd-d125-5b78-8bfd-adafcae7b165_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475308,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1759683-4168512-13.jpg',
             'Width': 1500}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-12-22',
 'seller_name': None,
 'title': 'NISSAN JUKE 1.2 DiG-T Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T Tekna 5dr',
 'year': 2015}
2026-04-22 13:12:18 [manheim.gb] INFO: Saving data for 1759683: {'created_time': 1776863538.144395, 'last_price_update_time': 1776863538.144407}
2026-04-22 13:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c098cd70-4a96-5790-8b6b-88a2e27644af with identifier: 190944
2026-04-22 13:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c098cd70-4a96-5790-8b6b-88a2e27644af with identifier: 190944
2026-04-22 13:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: c098cd70-4a96-5790-8b6b-88a2e27644af with identifier: 190944 to the API
2026-04-22 13:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'c098cd70-4a96-5790-8b6b-88a2e27644af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KS64ZSY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=190944',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 113215,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-02-06',
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 2.0 TDI GTD 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI GTD 5dr',
 'year': 2015}
2026-04-22 13:12:18 [manheim.gb] INFO: Saving data for 190944: {'created_time': 1776863538.505617, 'last_price_update_time': 1776863538.505633}
2026-04-22 13:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-001.jpg> (referer: None)
2026-04-22 13:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_10.jpg> (referer: None)
2026-04-22 13:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-010.jpg not downloaded yet
2026-04-22 13:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_1.jpg not downloaded yet
2026-04-22 13:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05cc4d0>
2026-04-22 13:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_2.jpg saved to cache
2026-04-22 13:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe
2026-04-22 13:12:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51637c52-11e8-5f08-b89d-60fcb3c89bbe, skipping ID generation
2026-04-22 13:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe with scrape type 1
2026-04-22 13:12:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51637c52-11e8-5f08-b89d-60fcb3c89bbe sending to next pipeline
2026-04-22 13:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 51637c52-11e8-5f08-b89d-60fcb3c89bbe, identifier: 1720405
2026-04-22 13:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 610ca983-f75b-58d0-8d7d-b25f4e16bcea with identifier: 1939917
2026-04-22 13:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea with scrape type 1
2026-04-22 13:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea
2026-04-22 13:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_7.jpg not downloaded yet
2026-04-22 13:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 51637c52-11e8-5f08-b89d-60fcb3c89bbe with identifier: 1720405
2026-04-22 13:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 51637c52-11e8-5f08-b89d-60fcb3c89bbe with identifier: 1720405
2026-04-22 13:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 51637c52-11e8-5f08-b89d-60fcb3c89bbe with identifier: 1720405 to the API
2026-04-22 13:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '51637c52-11e8-5f08-b89d-60fcb3c89bbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'MM17ZFH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=1720405',
 'listing': 'auction',
 'location': 'Manchester',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': 103544,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214277,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214277,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261953,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187901,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215533,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208942,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218087,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215826,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214805,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51637c52-11e8-5f08-b89d-60fcb3c89bbe/51637c52-11e8-5f08-b89d-60fcb3c89bbe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276723,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b3d55bec-0041-46d4-a6de-ff0dc830467a_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-06-30',
 'seller_name': None,
 'title': 'MERCEDES-BENZ A CLASS A180d Sport Premium 5dr',
 'transmission': 'manual',
 'trim': 'A180d Sport Premium 5dr',
 'year': 2017}
2026-04-22 13:12:19 [manheim.gb] INFO: Saving data for 1720405: {'created_time': 1776863539.176168, 'last_price_update_time': 1776863539.176183}
2026-04-22 13:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b052ae90>
2026-04-22 13:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-005.jpg saved to cache
2026-04-22 13:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 32f7da02-d72d-5650-abc6-62ad30a3702c
2026-04-22 13:12:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32f7da02-d72d-5650-abc6-62ad30a3702c, skipping ID generation
2026-04-22 13:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32f7da02-d72d-5650-abc6-62ad30a3702c with scrape type 1
2026-04-22 13:12:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32f7da02-d72d-5650-abc6-62ad30a3702c sending to next pipeline
2026-04-22 13:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 32f7da02-d72d-5650-abc6-62ad30a3702c, identifier: 1719909
2026-04-22 13:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-004.jpg> (referer: None)
2026-04-22 13:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_5.jpg not downloaded yet
2026-04-22 13:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_7.jpg not downloaded yet
2026-04-22 13:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 32f7da02-d72d-5650-abc6-62ad30a3702c with identifier: 1719909
2026-04-22 13:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 32f7da02-d72d-5650-abc6-62ad30a3702c with identifier: 1719909
2026-04-22 13:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 32f7da02-d72d-5650-abc6-62ad30a3702c with identifier: 1719909 to the API
2026-04-22 13:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-005.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '32f7da02-d72d-5650-abc6-62ad30a3702c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KK15CXN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/DS/DS%203?id=1719909',
 'listing': 'auction',
 'location': 'Washington',
 'longitude': None,
 'make': 'DS',
 'model': 'DS 3',
 'odometer': 75163,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371458,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1719909-4167002-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245835,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182281,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215151,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274364,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275962,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237892,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262412,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242121,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32f7da02-d72d-5650-abc6-62ad30a3702c/32f7da02-d72d-5650-abc6-62ad30a3702c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287929,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1719909-9999999-111104253-002.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-07-29',
 'seller_name': None,
 'title': 'DS DS 3 1.6 BlueHDi DStyle Nav 3dr',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi DStyle Nav 3dr',
 'year': 2015}
2026-04-22 13:12:19 [manheim.gb] INFO: Saving data for 1719909: {'created_time': 1776863539.740042, 'last_price_update_time': 1776863539.740053}
2026-04-22 13:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1038410>
2026-04-22 13:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-009.jpg saved to cache
2026-04-22 13:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77
2026-04-22 13:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0682ad0>
2026-04-22 13:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-008.jpg saved to cache
2026-04-22 13:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbfac648-394b-55bf-8937-9df838a53d61
2026-04-22 13:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82005b02-81b4-57bf-a885-7b67526393c9 with identifier: 1943843
2026-04-22 13:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82005b02-81b4-57bf-a885-7b67526393c9 with scrape type 1
2026-04-22 13:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 82005b02-81b4-57bf-a885-7b67526393c9
2026-04-22 13:12:19 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 82005b02-81b4-57bf-a885-7b67526393c9
2026-04-22 13:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 82005b02-81b4-57bf-a885-7b67526393c9, identifier: 1943843
2026-04-22 13:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 82005b02-81b4-57bf-a885-7b67526393c9 with identifier: 1943843
2026-04-22 13:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 82005b02-81b4-57bf-a885-7b67526393c9 with identifier: 1943843
2026-04-22 13:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 82005b02-81b4-57bf-a885-7b67526393c9 with identifier: 1943843 to the API
2026-04-22 13:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:20 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 82005b02-81b4-57bf-a885-7b67526393c9: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:19 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:20 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:20 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Plymouth - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '82005b02-81b4-57bf-a885-7b67526393c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WJ65VUY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/SCENIC?id=1943843',
 'listing': 'auction',
 'location': 'Plymouth - In Transit',
 'longitude': None,
 'make': 'RENAULT',
 'model': 'SCENIC',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'RENAULT SCENIC 1.5 dCi Dynamique Nav 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi Dynamique Nav 5dr',
 'year': 2015}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:20 [manheim.gb] INFO: Saving data for 1943843: {'created_time': 1776863540.283988, 'last_price_update_time': 1776863540.284001}
2026-04-22 13:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b172b010>
2026-04-22 13:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-001.jpg saved to cache
2026-04-22 13:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbfac648-394b-55bf-8937-9df838a53d61
2026-04-22 13:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fae6d0>
2026-04-22 13:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_10.jpg saved to cache
2026-04-22 13:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1830dce-89f6-5501-aa78-9460a6b30c59
2026-04-22 13:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-003.jpg> (referer: None)
2026-04-22 13:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_4.jpg not downloaded yet
2026-04-22 13:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_6.jpg not downloaded yet
2026-04-22 13:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_2.jpg> (referer: None)
2026-04-22 13:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_9.jpg> (referer: None)
2026-04-22 13:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd3a1d74-a887-5c76-982b-ca1d29fe8b7b with identifier: 1971707
2026-04-22 13:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3a1d74-a887-5c76-982b-ca1d29fe8b7b with scrape type 1
2026-04-22 13:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item dd3a1d74-a887-5c76-982b-ca1d29fe8b7b
2026-04-22 13:12:20 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item dd3a1d74-a887-5c76-982b-ca1d29fe8b7b
2026-04-22 13:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: dd3a1d74-a887-5c76-982b-ca1d29fe8b7b, identifier: 1971707
2026-04-22 13:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b19f5c50>
2026-04-22 13:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-004.jpg saved to cache
2026-04-22 13:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbfac648-394b-55bf-8937-9df838a53d61
2026-04-22 13:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-002.jpg> (referer: None)
2026-04-22 13:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_5.jpg> (referer: None)
2026-04-22 13:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_11.jpg not downloaded yet
2026-04-22 13:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_1.jpg not downloaded yet
2026-04-22 13:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: dd3a1d74-a887-5c76-982b-ca1d29fe8b7b with identifier: 1971707
2026-04-22 13:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: dd3a1d74-a887-5c76-982b-ca1d29fe8b7b with identifier: 1971707
2026-04-22 13:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: dd3a1d74-a887-5c76-982b-ca1d29fe8b7b with identifier: 1971707 to the API
2026-04-22 13:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'dd3a1d74-a887-5c76-982b-ca1d29fe8b7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'EK64DSU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/KUGA?id=1971707',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 86275,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-10-31',
 'seller_name': None,
 'title': 'FORD KUGA 2.0 TDCi Titanium X 5dr 2WD',
 'transmission': 'manual',
 'trim': '2.0 TDCi Titanium X 5dr 2WD',
 'year': 2014}
2026-04-22 13:12:20 [manheim.gb] INFO: Saving data for 1971707: {'created_time': 1776863540.983502, 'last_price_update_time': 1776863540.983514}
2026-04-22 13:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_7.jpg> (referer: None)
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_10.jpg not downloaded yet
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_5.jpg not downloaded yet
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0693610>
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-003.jpg saved to cache
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77
2026-04-22 13:12:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f42863da-e1a0-5c79-bc1b-e2b4a8429b77, skipping ID generation
2026-04-22 13:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77 with scrape type 1
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f42863da-e1a0-5c79-bc1b-e2b4a8429b77 sending to next pipeline
2026-04-22 13:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f42863da-e1a0-5c79-bc1b-e2b4a8429b77, identifier: 1651581
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1022990>
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_2.jpg saved to cache
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1830dce-89f6-5501-aa78-9460a6b30c59
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16e3110>
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_9.jpg saved to cache
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1830dce-89f6-5501-aa78-9460a6b30c59
2026-04-22 13:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-003.jpg> (referer: None)
2026-04-22 13:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-005.jpg> (referer: None)
2026-04-22 13:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f42863da-e1a0-5c79-bc1b-e2b4a8429b77 with identifier: 1651581
2026-04-22 13:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f42863da-e1a0-5c79-bc1b-e2b4a8429b77 with identifier: 1651581
2026-04-22 13:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f42863da-e1a0-5c79-bc1b-e2b4a8429b77 with identifier: 1651581 to the API
2026-04-22 13:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-003.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'f42863da-e1a0-5c79-bc1b-e2b4a8429b77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YM66YGZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=1651581',
 'listing': 'auction',
 'location': 'Washington',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 60692,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396923,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1651581-4169581-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300496,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260176,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289974,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253485,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280662,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255078,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248756,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265127,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f42863da-e1a0-5c79-bc1b-e2b4a8429b77/f42863da-e1a0-5c79-bc1b-e2b4a8429b77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315257,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1651581-9999999-112102011-009.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-02-06',
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PureTech Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure 5dr',
 'year': 2017}
2026-04-22 13:12:21 [manheim.gb] INFO: Saving data for 1651581: {'created_time': 1776863541.650015, 'last_price_update_time': 1776863541.650025}
2026-04-22 13:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_7.jpg> (referer: None)
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_9.jpg not downloaded yet
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_4.jpg not downloaded yet
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14ae2d0>
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-002.jpg saved to cache
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbfac648-394b-55bf-8937-9df838a53d61
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0758550>
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_5.jpg saved to cache
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1830dce-89f6-5501-aa78-9460a6b30c59
2026-04-22 13:12:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1830dce-89f6-5501-aa78-9460a6b30c59, skipping ID generation
2026-04-22 13:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1830dce-89f6-5501-aa78-9460a6b30c59 with scrape type 1
2026-04-22 13:12:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1830dce-89f6-5501-aa78-9460a6b30c59 sending to next pipeline
2026-04-22 13:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b1830dce-89f6-5501-aa78-9460a6b30c59, identifier: 1616203
2026-04-22 13:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b1830dce-89f6-5501-aa78-9460a6b30c59 with identifier: 1616203
2026-04-22 13:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b1830dce-89f6-5501-aa78-9460a6b30c59 with identifier: 1616203
2026-04-22 13:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b1830dce-89f6-5501-aa78-9460a6b30c59 with identifier: 1616203 to the API
2026-04-22 13:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Shotts',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'b1830dce-89f6-5501-aa78-9460a6b30c59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'EK67MPE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/GRAND%20C-MAX?id=1616203',
 'listing': 'auction',
 'location': 'Shotts',
 'longitude': None,
 'make': 'FORD',
 'model': 'GRAND C-MAX',
 'odometer': 112710,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218941,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218941,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251623,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222479,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1616203-4166609-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274250,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234364,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211441,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247658,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216881,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b1830dce-89f6-5501-aa78-9460a6b30c59/b1830dce-89f6-5501-aa78-9460a6b30c59_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198749,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb9ab0a-c401-4afd-a0d1-3fba826b0a82_10.jpg',
             'Width': 1500}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-10-18',
 'seller_name': None,
 'title': 'FORD GRAND C-MAX 1.5 TDCi Titanium X 5dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi Titanium X 5dr',
 'year': 2017}
2026-04-22 13:12:22 [manheim.gb] INFO: Saving data for 1616203: {'created_time': 1776863542.260327, 'last_price_update_time': 1776863542.260341}
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_2.jpg not downloaded yet
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_11.jpg not downloaded yet
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1614250>
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_7.jpg saved to cache
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 081dd353-b90b-5e7a-9240-ed48f668cfad
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fbc0d0>
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-003.jpg saved to cache
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbfac648-394b-55bf-8937-9df838a53d61
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b077a1d0>
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-005.jpg saved to cache
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbfac648-394b-55bf-8937-9df838a53d61
2026-04-22 13:12:22 [manheim.gb] INFO: Page 3: 100 results (total: 14785)
2026-04-22 13:12:22 [manheim.gb] INFO: Found listing with ID: 1984951
2026-04-22 13:12:22 [manheim.gb] INFO: Scrape type for 1984951: 0
2026-04-22 13:12:22 [manheim.gb] INFO: Found listing with ID: 1988390
2026-04-22 13:12:22 [manheim.gb] INFO: Scrape type for 1988390: 0
2026-04-22 13:12:22 [manheim.gb] INFO: Found listing with ID: 1990111
2026-04-22 13:12:22 [manheim.gb] INFO: Scrape type for 1990111: 0
2026-04-22 13:12:22 [manheim.gb] INFO: Found listing with ID: 1997190
2026-04-22 13:12:22 [manheim.gb] INFO: Scrape type for 1997190: 0
2026-04-22 13:12:22 [manheim.gb] INFO: Found listing with ID: 1998858
2026-04-22 13:12:22 [manheim.gb] INFO: Scrape type for 1998858: 1
2026-04-22 13:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_6.jpg> (referer: None)
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b188bc50>
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_7.jpg saved to cache
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 081dd353-b90b-5e7a-9240-ed48f668cfad
2026-04-22 13:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-007.jpg> (referer: None)
2026-04-22 13:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-006.jpg> (referer: None)
2026-04-22 13:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_9.jpg> (referer: None)
2026-04-22 13:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_7.jpg> (referer: None)
2026-04-22 13:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_7.jpg> (referer: None)
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_10.jpg not downloaded yet
2026-04-22 13:12:22 [manheim.gb] INFO: Found listing with ID: 1999219
2026-04-22 13:12:22 [manheim.gb] INFO: Scrape type for 1999219: 1
2026-04-22 13:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-009.jpg> (referer: None)
2026-04-22 13:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_5.jpg> (referer: None)
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_9.jpg not downloaded yet
2026-04-22 13:12:22 [manheim.gb] INFO: Found listing with ID: 2000390
2026-04-22 13:12:22 [manheim.gb] INFO: Scrape type for 2000390: 1
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_2.jpg not downloaded yet
2026-04-22 13:12:22 [manheim.gb] INFO: Found listing with ID: 2008069
2026-04-22 13:12:22 [manheim.gb] INFO: Scrape type for 2008069: 0
2026-04-22 13:12:22 [manheim.gb] INFO: Found listing with ID: 2011708
2026-04-22 13:12:22 [manheim.gb] INFO: Scrape type for 2011708: 0
2026-04-22 13:12:22 [manheim.gb] INFO: Found listing with ID: 2014809
2026-04-22 13:12:22 [manheim.gb] INFO: Scrape type for 2014809: 0
2026-04-22 13:12:22 [manheim.gb] INFO: Found listing with ID: 2016547
2026-04-22 13:12:22 [manheim.gb] INFO: Scrape type for 2016547: 1
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06fba50>
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_6.jpg saved to cache
2026-04-22 13:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 081dd353-b90b-5e7a-9240-ed48f668cfad
2026-04-22 13:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:22 [manheim.gb] INFO: Found listing with ID: 2017514
2026-04-22 13:12:22 [manheim.gb] INFO: Scrape type for 2017514: 0
2026-04-22 13:12:22 [manheim.gb] INFO: Found listing with ID: 2017684
2026-04-22 13:12:23 [manheim.gb] INFO: Scrape type for 2017684: 0
2026-04-22 13:12:23 [manheim.gb] INFO: Found listing with ID: 2020510
2026-04-22 13:12:23 [manheim.gb] INFO: Scrape type for 2020510: 1
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16e0290>
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-007.jpg saved to cache
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbfac648-394b-55bf-8937-9df838a53d61
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b062a410>
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-006.jpg saved to cache
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbfac648-394b-55bf-8937-9df838a53d61
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b062ebd0>
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_9.jpg saved to cache
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8625c0c2-30e0-55d5-8490-1fd89da7281a
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b17ec2d0>
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_7.jpg saved to cache
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fa7dd0>
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_7.jpg saved to cache
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b11971d0>
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-009.jpg saved to cache
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbfac648-394b-55bf-8937-9df838a53d61
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1504f10>
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_5.jpg saved to cache
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 081dd353-b90b-5e7a-9240-ed48f668cfad
2026-04-22 13:12:23 [manheim.gb] INFO: Found listing with ID: 2028284
2026-04-22 13:12:23 [manheim.gb] INFO: Scrape type for 2028284: 1
2026-04-22 13:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_1.jpg> (referer: None)
2026-04-22 13:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_11.jpg> (referer: None)
2026-04-22 13:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:23 [manheim.gb] INFO: Found listing with ID: 2029694
2026-04-22 13:12:23 [manheim.gb] INFO: Scrape type for 2029694: 1
2026-04-22 13:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab84dac3-c9a3-57c0-baf3-fb93a156ad96 with identifier: 1998858
2026-04-22 13:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab84dac3-c9a3-57c0-baf3-fb93a156ad96 with scrape type 1
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item ab84dac3-c9a3-57c0-baf3-fb93a156ad96
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1998858-4169016-3.jpg not downloaded yet
2026-04-22 13:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_1.jpg> (referer: None)
2026-04-22 13:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_4.jpg> (referer: None)
2026-04-22 13:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_5.jpg> (referer: None)
2026-04-22 13:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_10.jpg> (referer: None)
2026-04-22 13:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-010.jpg> (referer: None)
2026-04-22 13:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:23 [manheim.gb] INFO: Found listing with ID: 2038977
2026-04-22 13:12:23 [manheim.gb] INFO: Scrape type for 2038977: 1
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1998858-4169016-13.jpg not downloaded yet
2026-04-22 13:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_6.jpg> (referer: None)
2026-04-22 13:12:23 [manheim.gb] INFO: Found listing with ID: 2048324
2026-04-22 13:12:23 [manheim.gb] INFO: Scrape type for 2048324: 1
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04c46d0>
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_1.jpg saved to cache
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04feb50>
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_11.jpg saved to cache
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 081dd353-b90b-5e7a-9240-ed48f668cfad
2026-04-22 13:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16285355-b6b2-5841-93f0-b455c29f6f0a with identifier: 1999219
2026-04-22 13:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16285355-b6b2-5841-93f0-b455c29f6f0a with scrape type 1
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 16285355-b6b2-5841-93f0-b455c29f6f0a
2026-04-22 13:12:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 16285355-b6b2-5841-93f0-b455c29f6f0a
2026-04-22 13:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 16285355-b6b2-5841-93f0-b455c29f6f0a, identifier: 1999219
2026-04-22 13:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:23 [manheim.gb] INFO: Found listing with ID: 2050036
2026-04-22 13:12:23 [manheim.gb] INFO: Scrape type for 2050036: 0
2026-04-22 13:12:23 [manheim.gb] INFO: Found listing with ID: 2050835
2026-04-22 13:12:23 [manheim.gb] INFO: Scrape type for 2050835: 0
2026-04-22 13:12:23 [manheim.gb] INFO: Found listing with ID: 2053785
2026-04-22 13:12:23 [manheim.gb] INFO: Scrape type for 2053785: 0
2026-04-22 13:12:23 [manheim.gb] INFO: Found listing with ID: 2054079
2026-04-22 13:12:23 [manheim.gb] INFO: Scrape type for 2054079: 1
2026-04-22 13:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 16285355-b6b2-5841-93f0-b455c29f6f0a with identifier: 1999219
2026-04-22 13:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 16285355-b6b2-5841-93f0-b455c29f6f0a with identifier: 1999219
2026-04-22 13:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 16285355-b6b2-5841-93f0-b455c29f6f0a with identifier: 1999219 to the API
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:24 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 16285355-b6b2-5841-93f0-b455c29f6f0a: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:23 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:24 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:24 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '16285355-b6b2-5841-93f0-b455c29f6f0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'FP18WMV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=1999219',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'CITROEN',
 'model': 'C3',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-05-31',
 'seller_name': None,
 'title': 'CITROEN C3 1.2 PureTech 82 Feel 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 82 Feel 5dr',
 'year': 2018}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:24 [manheim.gb] INFO: Saving data for 1999219: {'created_time': 1776863544.218105, 'last_price_update_time': 1776863544.218116}
2026-04-22 13:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_11.jpg> (referer: None)
2026-04-22 13:12:24 [manheim.gb] INFO: Found listing with ID: 2055375
2026-04-22 13:12:24 [manheim.gb] INFO: Scrape type for 2055375: 1
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0ff4390>
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_1.jpg saved to cache
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 081dd353-b90b-5e7a-9240-ed48f668cfad
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fa6f90>
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_4.jpg saved to cache
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 081dd353-b90b-5e7a-9240-ed48f668cfad
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03ba1d0>
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_5.jpg saved to cache
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05e0810>
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_10.jpg saved to cache
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 081dd353-b90b-5e7a-9240-ed48f668cfad
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03b8390>
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-010.jpg saved to cache
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbfac648-394b-55bf-8937-9df838a53d61
2026-04-22 13:12:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbfac648-394b-55bf-8937-9df838a53d61, skipping ID generation
2026-04-22 13:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbfac648-394b-55bf-8937-9df838a53d61 with scrape type 1
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbfac648-394b-55bf-8937-9df838a53d61 sending to next pipeline
2026-04-22 13:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: dbfac648-394b-55bf-8937-9df838a53d61, identifier: 1804173
2026-04-22 13:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68af8f7-6990-521b-9375-da05463e8d16 with identifier: 2016547
2026-04-22 13:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68af8f7-6990-521b-9375-da05463e8d16 with scrape type 1
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d68af8f7-6990-521b-9375-da05463e8d16
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_7.jpg not downloaded yet
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1805490>
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_6.jpg saved to cache
2026-04-22 13:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea
2026-04-22 13:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_4.jpg> (referer: None)
2026-04-22 13:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_10.jpg> (referer: None)
2026-04-22 13:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_9.jpg> (referer: None)
2026-04-22 13:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: dbfac648-394b-55bf-8937-9df838a53d61 with identifier: 1804173
2026-04-22 13:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: dbfac648-394b-55bf-8937-9df838a53d61 with identifier: 1804173
2026-04-22 13:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: dbfac648-394b-55bf-8937-9df838a53d61 with identifier: 1804173 to the API
2026-04-22 13:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-010.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'dbfac648-394b-55bf-8937-9df838a53d61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'RF65CYT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGE%20ROVER%20EVOQUE?id=1804173',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 95017,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597260,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267094,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256714,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495167,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547893,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427226,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443630,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 445957,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358526,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbfac648-394b-55bf-8937-9df838a53d61/dbfac648-394b-55bf-8937-9df838a53d61_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251639,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1804173-9999999-111130645-010.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-11-20',
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 eD4 SE Tech 5dr 2WD',
 'transmission': 'manual',
 'trim': '2.0 eD4 SE Tech 5dr 2WD',
 'year': 2015}
2026-04-22 13:12:25 [manheim.gb] INFO: Saving data for 1804173: {'created_time': 1776863545.255024, 'last_price_update_time': 1776863545.255034}
2026-04-22 13:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f356f9a8-fade-560a-9720-f4712c19850b with identifier: 2020510
2026-04-22 13:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f356f9a8-fade-560a-9720-f4712c19850b with scrape type 1
2026-04-22 13:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f356f9a8-fade-560a-9720-f4712c19850b
2026-04-22 13:12:25 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f356f9a8-fade-560a-9720-f4712c19850b
2026-04-22 13:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f356f9a8-fade-560a-9720-f4712c19850b, identifier: 2020510
2026-04-22 13:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_10.jpg> (referer: None)
2026-04-22 13:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_9.jpg> (referer: None)
2026-04-22 13:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_2.jpg> (referer: None)
2026-04-22 13:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:25 [manheim.gb] INFO: Found listing with ID: 2057640
2026-04-22 13:12:25 [manheim.gb] INFO: Scrape type for 2057640: 1
2026-04-22 13:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_7.jpg not downloaded yet
2026-04-22 13:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f356f9a8-fade-560a-9720-f4712c19850b with identifier: 2020510
2026-04-22 13:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:12:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2026-04-22 13:12:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f356f9a8-fade-560a-9720-f4712c19850b with identifier: 2020510
2026-04-22 13:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f356f9a8-fade-560a-9720-f4712c19850b with identifier: 2020510 to the API
2026-04-22 13:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'f356f9a8-fade-560a-9720-f4712c19850b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'XX51ACX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/COUNTRYMAN?id=2020510',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 131860,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2012-01-04',
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.6 Cooper 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 Cooper 5dr Auto',
 'year': 2012}
2026-04-22 13:12:26 [manheim.gb] INFO: Saving data for 2020510: {'created_time': 1776863546.065277, 'last_price_update_time': 1776863546.06529}
2026-04-22 13:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_2.jpg> (referer: None)
2026-04-22 13:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 010d608c-1dca-5bbf-93bb-3bee5c2a7bfc with identifier: 2000390
2026-04-22 13:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010d608c-1dca-5bbf-93bb-3bee5c2a7bfc with scrape type 1
2026-04-22 13:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 010d608c-1dca-5bbf-93bb-3bee5c2a7bfc
2026-04-22 13:12:26 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 010d608c-1dca-5bbf-93bb-3bee5c2a7bfc
2026-04-22 13:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 010d608c-1dca-5bbf-93bb-3bee5c2a7bfc, identifier: 2000390
2026-04-22 13:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 463897b0-b143-5d86-afd1-aa3748b8cb56 with identifier: 2028284
2026-04-22 13:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 463897b0-b143-5d86-afd1-aa3748b8cb56 with scrape type 1
2026-04-22 13:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 463897b0-b143-5d86-afd1-aa3748b8cb56
2026-04-22 13:12:26 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 463897b0-b143-5d86-afd1-aa3748b8cb56
2026-04-22 13:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 463897b0-b143-5d86-afd1-aa3748b8cb56, identifier: 2028284
2026-04-22 13:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64bed74e-d204-568e-bc06-bc82ed5e7be9 with identifier: 2029694
2026-04-22 13:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64bed74e-d204-568e-bc06-bc82ed5e7be9 with scrape type 1
2026-04-22 13:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 64bed74e-d204-568e-bc06-bc82ed5e7be9
2026-04-22 13:12:26 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 64bed74e-d204-568e-bc06-bc82ed5e7be9
2026-04-22 13:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 64bed74e-d204-568e-bc06-bc82ed5e7be9, identifier: 2029694
2026-04-22 13:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06d95d0>
2026-04-22 13:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_11.jpg saved to cache
2026-04-22 13:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea
2026-04-22 13:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:26 [manheim.gb] INFO: Found listing with ID: 206629
2026-04-22 13:12:26 [manheim.gb] INFO: Scrape type for 206629: 1
2026-04-22 13:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_6.jpg not downloaded yet
2026-04-22 13:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 010d608c-1dca-5bbf-93bb-3bee5c2a7bfc with identifier: 2000390
2026-04-22 13:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 010d608c-1dca-5bbf-93bb-3bee5c2a7bfc with identifier: 2000390
2026-04-22 13:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 010d608c-1dca-5bbf-93bb-3bee5c2a7bfc with identifier: 2000390 to the API
2026-04-22 13:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:26 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 010d608c-1dca-5bbf-93bb-3bee5c2a7bfc: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:26 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:26 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:26 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '010d608c-1dca-5bbf-93bb-3bee5c2a7bfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'EJ18YMT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/TOURNEO?id=2000390',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'FORD',
 'model': 'TOURNEO',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-05-16',
 'seller_name': None,
 'title': 'FORD TOURNEO 2.0 TDCi EcoBlue 170ps Low Roof 8 Seater Sport',
 'transmission': 'automatic',
 'trim': '2.0 TDCi EcoBlue 170ps Low Roof 8 Seater Sport',
 'year': 2018}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:26 [manheim.gb] INFO: Saving data for 2000390: {'created_time': 1776863546.798801, 'last_price_update_time': 1776863546.798812}
2026-04-22 13:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 463897b0-b143-5d86-afd1-aa3748b8cb56 with identifier: 2028284
2026-04-22 13:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 463897b0-b143-5d86-afd1-aa3748b8cb56 with identifier: 2028284
2026-04-22 13:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 463897b0-b143-5d86-afd1-aa3748b8cb56 with identifier: 2028284 to the API
2026-04-22 13:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:27 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 463897b0-b143-5d86-afd1-aa3748b8cb56: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:26 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:27 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:27 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.7L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '463897b0-b143-5d86-afd1-aa3748b8cb56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'AO66YVB',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=2028284',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-02-01',
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.7 CRDi ISG 4 5dr',
 'transmission': 'manual',
 'trim': '1.7 CRDi ISG 4 5dr',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:27 [manheim.gb] INFO: Saving data for 2028284: {'created_time': 1776863547.115747, 'last_price_update_time': 1776863547.115759}
2026-04-22 13:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 64bed74e-d204-568e-bc06-bc82ed5e7be9 with identifier: 2029694
2026-04-22 13:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:12:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BRILLIANT+BLACK HTTP/1.1" 200 None
2026-04-22 13:12:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 64bed74e-d204-568e-bc06-bc82ed5e7be9 with identifier: 2029694
2026-04-22 13:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 64bed74e-d204-568e-bc06-bc82ed5e7be9 with identifier: 2029694 to the API
2026-04-22 13:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington',
 'color': 'BRILLIANT BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '64bed74e-d204-568e-bc06-bc82ed5e7be9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DC65ZXZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A4?id=2029694',
 'listing': 'auction',
 'location': 'Washington',
 'longitude': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 140060,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-02-03',
 'seller_name': None,
 'title': 'AUDI A4 2.0 TDI 190 S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TDI 190 S Line 5dr S Tronic',
 'year': 2016}
2026-04-22 13:12:27 [manheim.gb] INFO: Saving data for 2029694: {'created_time': 1776863547.771914, 'last_price_update_time': 1776863547.771926}
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b107d7d0>
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_4.jpg saved to cache
2026-04-22 13:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04b1510>
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_10.jpg saved to cache
2026-04-22 13:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b077cc90>
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_9.jpg saved to cache
2026-04-22 13:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1756450>
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_10.jpg saved to cache
2026-04-22 13:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8625c0c2-30e0-55d5-8490-1fd89da7281a
2026-04-22 13:12:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8625c0c2-30e0-55d5-8490-1fd89da7281a, skipping ID generation
2026-04-22 13:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8625c0c2-30e0-55d5-8490-1fd89da7281a with scrape type 1
2026-04-22 13:12:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8625c0c2-30e0-55d5-8490-1fd89da7281a sending to next pipeline
2026-04-22 13:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8625c0c2-30e0-55d5-8490-1fd89da7281a, identifier: 1562438
2026-04-22 13:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05d5a90>
2026-04-22 13:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_9.jpg saved to cache
2026-04-22 13:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 081dd353-b90b-5e7a-9240-ed48f668cfad
2026-04-22 13:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05730d0>
2026-04-22 13:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_2.jpg saved to cache
2026-04-22 13:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 081dd353-b90b-5e7a-9240-ed48f668cfad
2026-04-22 13:12:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 081dd353-b90b-5e7a-9240-ed48f668cfad, skipping ID generation
2026-04-22 13:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 081dd353-b90b-5e7a-9240-ed48f668cfad with scrape type 1
2026-04-22 13:12:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 081dd353-b90b-5e7a-9240-ed48f668cfad sending to next pipeline
2026-04-22 13:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 081dd353-b90b-5e7a-9240-ed48f668cfad, identifier: 1899227
2026-04-22 13:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17e1269c-d74c-58b5-9cd1-2ccc06c6bcd8 with identifier: 2038977
2026-04-22 13:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e1269c-d74c-58b5-9cd1-2ccc06c6bcd8 with scrape type 1
2026-04-22 13:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 17e1269c-d74c-58b5-9cd1-2ccc06c6bcd8
2026-04-22 13:12:28 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 17e1269c-d74c-58b5-9cd1-2ccc06c6bcd8
2026-04-22 13:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 17e1269c-d74c-58b5-9cd1-2ccc06c6bcd8, identifier: 2038977
2026-04-22 13:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1998858-4169016-3.jpg> (referer: None)
2026-04-22 13:12:28 [manheim.gb] INFO: Found listing with ID: 2072416
2026-04-22 13:12:28 [manheim.gb] INFO: Scrape type for 2072416: 0
2026-04-22 13:12:28 [manheim.gb] INFO: Found listing with ID: 2079047
2026-04-22 13:12:28 [manheim.gb] INFO: Scrape type for 2079047: 0
2026-04-22 13:12:28 [manheim.gb] INFO: Found listing with ID: 208188
2026-04-22 13:12:28 [manheim.gb] INFO: Scrape type for 208188: 1
2026-04-22 13:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_1.jpg not downloaded yet
2026-04-22 13:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8625c0c2-30e0-55d5-8490-1fd89da7281a with identifier: 1562438
2026-04-22 13:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8625c0c2-30e0-55d5-8490-1fd89da7281a with identifier: 1562438
2026-04-22 13:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8625c0c2-30e0-55d5-8490-1fd89da7281a with identifier: 1562438 to the API
2026-04-22 13:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Plymouth',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '8625c0c2-30e0-55d5-8490-1fd89da7281a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'HJ64UDH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ABARTH/595?id=1562438',
 'listing': 'auction',
 'location': 'Plymouth',
 'longitude': None,
 'make': 'ABARTH',
 'model': '595',
 'odometer': 56906,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203424,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203424,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230415,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187007,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203833,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202736,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204471,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196457,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201642,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8625c0c2-30e0-55d5-8490-1fd89da7281a/8625c0c2-30e0-55d5-8490-1fd89da7281a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231104,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/13a77bc0-7df0-469d-8735-925b1f9d2712_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-11-28',
 'seller_name': None,
 'title': 'ABARTH 595 1.4 T-Jet Turismo 3dr',
 'transmission': 'manual',
 'trim': '1.4 T-Jet Turismo 3dr',
 'year': 2014}
2026-04-22 13:12:28 [manheim.gb] INFO: Saving data for 1562438: {'created_time': 1776863548.764244, 'last_price_update_time': 1776863548.764256}
2026-04-22 13:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 081dd353-b90b-5e7a-9240-ed48f668cfad with identifier: 1899227
2026-04-22 13:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 081dd353-b90b-5e7a-9240-ed48f668cfad with identifier: 1899227
2026-04-22 13:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 081dd353-b90b-5e7a-9240-ed48f668cfad with identifier: 1899227 to the API
2026-04-22 13:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '081dd353-b90b-5e7a-9240-ed48f668cfad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BT16UZA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/OCTAVIA?id=1899227',
 'listing': 'auction',
 'location': 'Birmingham',
 'longitude': None,
 'make': 'SKODA',
 'model': 'OCTAVIA',
 'odometer': 133116,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203511,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203511,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252747,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196956,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200000,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206009,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206037,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209075,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216371,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_081dd353-b90b-5e7a-9240-ed48f668cfad/081dd353-b90b-5e7a-9240-ed48f668cfad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208181,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c261f9d0-8860-4583-a8e5-811d8bbc83ab_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-06-15',
 'seller_name': None,
 'title': 'SKODA OCTAVIA 2.0 TDI CR vRS 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI CR vRS 5dr',
 'year': 2016}
2026-04-22 13:12:29 [manheim.gb] INFO: Saving data for 1899227: {'created_time': 1776863549.123456, 'last_price_update_time': 1776863549.123468}
2026-04-22 13:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 17e1269c-d74c-58b5-9cd1-2ccc06c6bcd8 with identifier: 2038977
2026-04-22 13:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 17e1269c-d74c-58b5-9cd1-2ccc06c6bcd8 with identifier: 2038977
2026-04-22 13:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 17e1269c-d74c-58b5-9cd1-2ccc06c6bcd8 with identifier: 2038977 to the API
2026-04-22 13:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:29 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 17e1269c-d74c-58b5-9cd1-2ccc06c6bcd8: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:28 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:29 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:29 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '17e1269c-d74c-58b5-9cd1-2ccc06c6bcd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'PN17KXH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/FABIA?id=2038977',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'SKODA',
 'model': 'FABIA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-31',
 'seller_name': None,
 'title': 'SKODA FABIA 1.0 MPI SE 5dr',
 'transmission': 'manual',
 'trim': '1.0 MPI SE 5dr',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:29 [manheim.gb] INFO: Saving data for 2038977: {'created_time': 1776863549.426798, 'last_price_update_time': 1776863549.426809}
2026-04-22 13:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03b0650>
2026-04-22 13:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_2.jpg saved to cache
2026-04-22 13:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea
2026-04-22 13:12:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 610ca983-f75b-58d0-8d7d-b25f4e16bcea, skipping ID generation
2026-04-22 13:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea with scrape type 1
2026-04-22 13:12:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 610ca983-f75b-58d0-8d7d-b25f4e16bcea sending to next pipeline
2026-04-22 13:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 610ca983-f75b-58d0-8d7d-b25f4e16bcea, identifier: 1939917
2026-04-22 13:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fbbc530-b90e-5e0a-9b7f-7b608bedfa55 with identifier: 2048324
2026-04-22 13:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fbbc530-b90e-5e0a-9b7f-7b608bedfa55 with scrape type 1
2026-04-22 13:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 5fbbc530-b90e-5e0a-9b7f-7b608bedfa55
2026-04-22 13:12:29 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 5fbbc530-b90e-5e0a-9b7f-7b608bedfa55
2026-04-22 13:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5fbbc530-b90e-5e0a-9b7f-7b608bedfa55, identifier: 2048324
2026-04-22 13:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 610ca983-f75b-58d0-8d7d-b25f4e16bcea with identifier: 1939917
2026-04-22 13:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 610ca983-f75b-58d0-8d7d-b25f4e16bcea with identifier: 1939917
2026-04-22 13:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 610ca983-f75b-58d0-8d7d-b25f4e16bcea with identifier: 1939917 to the API
2026-04-22 13:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Shepshed',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '610ca983-f75b-58d0-8d7d-b25f4e16bcea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DU15EXW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/COMBO?id=1939917',
 'listing': 'auction',
 'location': 'Shepshed',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'COMBO',
 'odometer': 66862,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151403,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151403,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272474,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66015,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133802,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143299,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126803,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138069,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141510,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_610ca983-f75b-58d0-8d7d-b25f4e16bcea/610ca983-f75b-58d0-8d7d-b25f4e16bcea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284244,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6cf8bba5-05d2-4482-b8ce-2fb70e09745a_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'VAUXHALL COMBO 2300 1.3 CDTI 16V ecoFLEX H1 Van',
 'transmission': 'manual',
 'trim': '2300 1.3 CDTI 16V ecoFLEX H1 Van',
 'year': 2015}
2026-04-22 13:12:30 [manheim.gb] INFO: Saving data for 1939917: {'created_time': 1776863550.018171, 'last_price_update_time': 1776863550.018182}
2026-04-22 13:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5fbbc530-b90e-5e0a-9b7f-7b608bedfa55 with identifier: 2048324
2026-04-22 13:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5fbbc530-b90e-5e0a-9b7f-7b608bedfa55 with identifier: 2048324
2026-04-22 13:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5fbbc530-b90e-5e0a-9b7f-7b608bedfa55 with identifier: 2048324 to the API
2026-04-22 13:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:30 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 5fbbc530-b90e-5e0a-9b7f-7b608bedfa55: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:29 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:30 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:30 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '5fbbc530-b90e-5e0a-9b7f-7b608bedfa55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BX12EPD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGE%20ROVER%20EVOQUE?id=2048324',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2012-05-22',
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.2 SD4 Dynamic 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.2 SD4 Dynamic 5dr Auto',
 'year': 2012}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:30 [manheim.gb] INFO: Saving data for 2048324: {'created_time': 1776863550.34397, 'last_price_update_time': 1776863550.343981}
2026-04-22 13:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e005b167-fc48-525f-b115-a8d7978fd824 with identifier: 2054079
2026-04-22 13:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e005b167-fc48-525f-b115-a8d7978fd824 with scrape type 1
2026-04-22 13:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e005b167-fc48-525f-b115-a8d7978fd824
2026-04-22 13:12:30 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e005b167-fc48-525f-b115-a8d7978fd824
2026-04-22 13:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e005b167-fc48-525f-b115-a8d7978fd824, identifier: 2054079
2026-04-22 13:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1998858-4169016-13.jpg> (referer: None)
2026-04-22 13:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:30 [manheim.gb] INFO: Found listing with ID: 2082599
2026-04-22 13:12:30 [manheim.gb] INFO: Scrape type for 2082599: 0
2026-04-22 13:12:30 [manheim.gb] INFO: Found listing with ID: 2083848
2026-04-22 13:12:30 [manheim.gb] INFO: Scrape type for 2083848: 0
2026-04-22 13:12:30 [manheim.gb] INFO: Found listing with ID: 2085210
2026-04-22 13:12:30 [manheim.gb] INFO: Scrape type for 2085210: 1
2026-04-22 13:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_5.jpg not downloaded yet
2026-04-22 13:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e005b167-fc48-525f-b115-a8d7978fd824 with identifier: 2054079
2026-04-22 13:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e005b167-fc48-525f-b115-a8d7978fd824 with identifier: 2054079
2026-04-22 13:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e005b167-fc48-525f-b115-a8d7978fd824 with identifier: 2054079 to the API
2026-04-22 13:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:30 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id e005b167-fc48-525f-b115-a8d7978fd824: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:30 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:30 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:30 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'e005b167-fc48-525f-b115-a8d7978fd824',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'OV17TNU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/JAGUAR/XF?id=2054079',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'JAGUAR',
 'model': 'XF',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'JAGUAR XF 2.0d [180] Portfolio 4dr Auto AWD',
 'transmission': 'automatic',
 'trim': '2.0d [180] Portfolio 4dr Auto AWD',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:30 [manheim.gb] INFO: Saving data for 2054079: {'created_time': 1776863550.825536, 'last_price_update_time': 1776863550.825547}
2026-04-22 13:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_7.jpg> (referer: None)
2026-04-22 13:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0518510>
2026-04-22 13:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab84dac3-c9a3-57c0-baf3-fb93a156ad96/ab84dac3-c9a3-57c0-baf3-fb93a156ad96_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1998858-4169016-3.jpg saved to cache
2026-04-22 13:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab84dac3-c9a3-57c0-baf3-fb93a156ad96
2026-04-22 13:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_7.jpg> (referer: None)
2026-04-22 13:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:30 [manheim.gb] INFO: Found listing with ID: 2085627
2026-04-22 13:12:30 [manheim.gb] INFO: Scrape type for 2085627: 0
2026-04-22 13:12:30 [manheim.gb] INFO: Found listing with ID: 2086404
2026-04-22 13:12:30 [manheim.gb] INFO: Scrape type for 2086404: 1
2026-04-22 13:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_4.jpg not downloaded yet
2026-04-22 13:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0 with identifier: 2055375
2026-04-22 13:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0 with scrape type 1
2026-04-22 13:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0
2026-04-22 13:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_7.jpg not downloaded yet
2026-04-22 13:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0519710>
2026-04-22 13:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab84dac3-c9a3-57c0-baf3-fb93a156ad96/ab84dac3-c9a3-57c0-baf3-fb93a156ad96_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1998858-4169016-13.jpg saved to cache
2026-04-22 13:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab84dac3-c9a3-57c0-baf3-fb93a156ad96
2026-04-22 13:12:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab84dac3-c9a3-57c0-baf3-fb93a156ad96, skipping ID generation
2026-04-22 13:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab84dac3-c9a3-57c0-baf3-fb93a156ad96 with scrape type 1
2026-04-22 13:12:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab84dac3-c9a3-57c0-baf3-fb93a156ad96 sending to next pipeline
2026-04-22 13:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ab84dac3-c9a3-57c0-baf3-fb93a156ad96, identifier: 1998858
2026-04-22 13:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9d0a5e3-139d-5bd9-a809-71fa6b182529 with identifier: 2057640
2026-04-22 13:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9d0a5e3-139d-5bd9-a809-71fa6b182529 with scrape type 1
2026-04-22 13:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item d9d0a5e3-139d-5bd9-a809-71fa6b182529
2026-04-22 13:12:31 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item d9d0a5e3-139d-5bd9-a809-71fa6b182529
2026-04-22 13:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d9d0a5e3-139d-5bd9-a809-71fa6b182529, identifier: 2057640
2026-04-22 13:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_6.jpg> (referer: None)
2026-04-22 13:12:31 [manheim.gb] INFO: Found listing with ID: 2088559
2026-04-22 13:12:31 [manheim.gb] INFO: Scrape type for 2088559: 0
2026-04-22 13:12:31 [manheim.gb] INFO: Found listing with ID: 2103765
2026-04-22 13:12:31 [manheim.gb] INFO: Scrape type for 2103765: 2
2026-04-22 13:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_11.jpg not downloaded yet
2026-04-22 13:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ab84dac3-c9a3-57c0-baf3-fb93a156ad96 with identifier: 1998858
2026-04-22 13:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ab84dac3-c9a3-57c0-baf3-fb93a156ad96 with identifier: 1998858
2026-04-22 13:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ab84dac3-c9a3-57c0-baf3-fb93a156ad96 with identifier: 1998858 to the API
2026-04-22 13:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-1998858-4169016-13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'ab84dac3-c9a3-57c0-baf3-fb93a156ad96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BG18MKE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=1998858',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': 61761,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_410ff630-6543-5547-ae72-a20ded1fd770/410ff630-6543-5547-ae72-a20ded1fd770_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_410ff630-6543-5547-ae72-a20ded1fd770/410ff630-6543-5547-ae72-a20ded1fd770_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab84dac3-c9a3-57c0-baf3-fb93a156ad96/ab84dac3-c9a3-57c0-baf3-fb93a156ad96_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227841,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1998858-4169016-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab84dac3-c9a3-57c0-baf3-fb93a156ad96/ab84dac3-c9a3-57c0-baf3-fb93a156ad96_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311294,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1998858-4169016-13.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-03-29',
 'seller_name': None,
 'title': 'MERCEDES-BENZ A CLASS A200 Sport Edition Plus 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A200 Sport Edition Plus 5dr Auto',
 'year': 2018}
2026-04-22 13:12:32 [manheim.gb] INFO: Saving data for 1998858: {'created_time': 1776863552.093207, 'last_price_update_time': 1776863552.093217}
2026-04-22 13:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d9d0a5e3-139d-5bd9-a809-71fa6b182529 with identifier: 2057640
2026-04-22 13:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d9d0a5e3-139d-5bd9-a809-71fa6b182529 with identifier: 2057640
2026-04-22 13:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: d9d0a5e3-139d-5bd9-a809-71fa6b182529 with identifier: 2057640 to the API
2026-04-22 13:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:32 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id d9d0a5e3-139d-5bd9-a809-71fa6b182529: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:32 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:32 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:32 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'd9d0a5e3-139d-5bd9-a809-71fa6b182529',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'RJ16JYO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/INFINITI/Q50?id=2057640',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'INFINITI',
 'model': 'Q50',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-06-21',
 'seller_name': None,
 'title': 'INFINITI Q50 2.2d SE 4dr Auto',
 'transmission': 'automatic',
 'trim': '2.2d SE 4dr Auto',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:32 [manheim.gb] INFO: Saving data for 2057640: {'created_time': 1776863552.525887, 'last_price_update_time': 1776863552.5259}
2026-04-22 13:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_7.jpg not downloaded yet
2026-04-22 13:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16ff110>
2026-04-22 13:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_7.jpg saved to cache
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d68af8f7-6990-521b-9375-da05463e8d16
2026-04-22 13:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06eed10>
2026-04-22 13:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_7.jpg saved to cache
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d68af8f7-6990-521b-9375-da05463e8d16
2026-04-22 13:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb1dca0b-810d-5cb9-86ce-d9f68facc4f2 with identifier: 206629
2026-04-22 13:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2 with scrape type 1
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_7.jpg not downloaded yet
2026-04-22 13:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:32 [manheim.gb] INFO: Found listing with ID: 2113720
2026-04-22 13:12:32 [manheim.gb] INFO: Scrape type for 2113720: 2
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_10.jpg not downloaded yet
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_6.jpg not downloaded yet
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_7.jpg not downloaded yet
2026-04-22 13:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1738550>
2026-04-22 13:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_6.jpg saved to cache
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d68af8f7-6990-521b-9375-da05463e8d16
2026-04-22 13:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_5.jpg> (referer: None)
2026-04-22 13:12:32 [manheim.gb] INFO: Found listing with ID: 2116878
2026-04-22 13:12:32 [manheim.gb] INFO: Scrape type for 2116878: 1
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_9.jpg not downloaded yet
2026-04-22 13:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebcdf364-0c98-5b71-b430-5971f0bd995f with identifier: 208188
2026-04-22 13:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebcdf364-0c98-5b71-b430-5971f0bd995f with scrape type 1
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ebcdf364-0c98-5b71-b430-5971f0bd995f
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ebcdf364-0c98-5b71-b430-5971f0bd995f
2026-04-22 13:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ebcdf364-0c98-5b71-b430-5971f0bd995f, identifier: 208188
2026-04-22 13:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_1.jpg> (referer: None)
2026-04-22 13:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_1.jpg not downloaded yet
2026-04-22 13:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_6.jpg not downloaded yet
2026-04-22 13:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ebcdf364-0c98-5b71-b430-5971f0bd995f with identifier: 208188
2026-04-22 13:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ebcdf364-0c98-5b71-b430-5971f0bd995f with identifier: 208188
2026-04-22 13:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ebcdf364-0c98-5b71-b430-5971f0bd995f with identifier: 208188 to the API
2026-04-22 13:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'ebcdf364-0c98-5b71-b430-5971f0bd995f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'VO11GSZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=208188',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 122559,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2011-03-16',
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO 1.4 SE 3dr',
 'transmission': 'manual',
 'trim': '1.4 SE 3dr',
 'year': 2011}
2026-04-22 13:12:35 [manheim.gb] INFO: Saving data for 208188: {'created_time': 1776863555.285734, 'last_price_update_time': 1776863555.285745}
2026-04-22 13:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:35 [manheim.gb] INFO: Found listing with ID: 2126881
2026-04-22 13:12:35 [manheim.gb] INFO: Scrape type for 2126881: 1
2026-04-22 13:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_2.jpg not downloaded yet
2026-04-22 13:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cf01c06-e1c0-577e-8fbf-12a3288b0ac1 with identifier: 2085210
2026-04-22 13:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cf01c06-e1c0-577e-8fbf-12a3288b0ac1 with scrape type 1
2026-04-22 13:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2cf01c06-e1c0-577e-8fbf-12a3288b0ac1
2026-04-22 13:12:35 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2cf01c06-e1c0-577e-8fbf-12a3288b0ac1
2026-04-22 13:12:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2cf01c06-e1c0-577e-8fbf-12a3288b0ac1, identifier: 2085210
2026-04-22 13:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_5.jpg not downloaded yet
2026-04-22 13:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_1.jpg not downloaded yet
2026-04-22 13:12:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2cf01c06-e1c0-577e-8fbf-12a3288b0ac1 with identifier: 2085210
2026-04-22 13:12:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2cf01c06-e1c0-577e-8fbf-12a3288b0ac1 with identifier: 2085210
2026-04-22 13:12:35 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 2cf01c06-e1c0-577e-8fbf-12a3288b0ac1 with identifier: 2085210 to the API
2026-04-22 13:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '2cf01c06-e1c0-577e-8fbf-12a3288b0ac1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'MJ64VOY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/COUNTRYMAN?id=2085210',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 103776,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-10-29',
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 2.0 Cooper S D 5dr',
 'transmission': 'manual',
 'trim': '2.0 Cooper S D 5dr',
 'year': 2014}
2026-04-22 13:12:35 [manheim.gb] INFO: Saving data for 2085210: {'created_time': 1776863555.845368, 'last_price_update_time': 1776863555.845378}
2026-04-22 13:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0732810>
2026-04-22 13:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_5.jpg saved to cache
2026-04-22 13:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d68af8f7-6990-521b-9375-da05463e8d16
2026-04-22 13:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_4.jpg> (referer: None)
2026-04-22 13:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:35 [manheim.gb] INFO: Found listing with ID: 2130963
2026-04-22 13:12:35 [manheim.gb] INFO: Scrape type for 2130963: 1
2026-04-22 13:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_7.jpg> (referer: None)
2026-04-22 13:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_11.jpg> (referer: None)
2026-04-22 13:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_7.jpg> (referer: None)
2026-04-22 13:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_7.jpg> (referer: None)
2026-04-22 13:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_10.jpg> (referer: None)
2026-04-22 13:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_4.jpg not downloaded yet
2026-04-22 13:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_5.jpg not downloaded yet
2026-04-22 13:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0682e90>
2026-04-22 13:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_1.jpg saved to cache
2026-04-22 13:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d68af8f7-6990-521b-9375-da05463e8d16
2026-04-22 13:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b81fa4e2-2b17-52bc-993e-3117e060d4ea with identifier: 2086404
2026-04-22 13:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b81fa4e2-2b17-52bc-993e-3117e060d4ea with scrape type 1
2026-04-22 13:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b81fa4e2-2b17-52bc-993e-3117e060d4ea
2026-04-22 13:12:36 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b81fa4e2-2b17-52bc-993e-3117e060d4ea
2026-04-22 13:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b81fa4e2-2b17-52bc-993e-3117e060d4ea, identifier: 2086404
2026-04-22 13:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ac7874b-08d1-5fe4-85c5-b17048a45e21 with identifier: 2103765
2026-04-22 13:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ac7874b-08d1-5fe4-85c5-b17048a45e21 with scrape type 2
2026-04-22 13:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ac7874b-08d1-5fe4-85c5-b17048a45e21 with scrape type 2
2026-04-22 13:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1ac7874b-08d1-5fe4-85c5-b17048a45e21, identifier: 2103765
2026-04-22 13:12:36 [manheim.gb] INFO: Found listing with ID: 2130964
2026-04-22 13:12:36 [manheim.gb] INFO: Scrape type for 2130964: 1
2026-04-22 13:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b81fa4e2-2b17-52bc-993e-3117e060d4ea with identifier: 2086404
2026-04-22 13:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b81fa4e2-2b17-52bc-993e-3117e060d4ea with identifier: 2086404
2026-04-22 13:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b81fa4e2-2b17-52bc-993e-3117e060d4ea with identifier: 2086404 to the API
2026-04-22 13:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:36 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id b81fa4e2-2b17-52bc-993e-3117e060d4ea: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:36 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:36 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:36 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '3.2L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'b81fa4e2-2b17-52bc-993e-3117e060d4ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YS17YLB',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/RANGER?id=2086404',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-06-14',
 'seller_name': None,
 'title': 'FORD RANGER Pick Up Double Cab Wildtrak 3.2 TDCi 4WD',
 'transmission': 'manual',
 'trim': 'Pick Up Double Cab Wildtrak 3.2 TDCi 4WD',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:36 [manheim.gb] INFO: Saving data for 2086404: {'created_time': 1776863556.558571, 'last_price_update_time': 1776863556.558585}
2026-04-22 13:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1ac7874b-08d1-5fe4-85c5-b17048a45e21 with identifier: 2103765
2026-04-22 13:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1ac7874b-08d1-5fe4-85c5-b17048a45e21 with identifier: 2103765
2026-04-22 13:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 1ac7874b-08d1-5fe4-85c5-b17048a45e21 with identifier: 2103765 to the API
2026-04-22 13:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '1ac7874b-08d1-5fe4-85c5-b17048a45e21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'HX67XXS',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=2103765',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 130841,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-10-05',
 'seller_name': None,
 'title': 'AUDI A3 1.6 TDI 116 Sport 4dr S Tronic',
 'transmission': 'automatic',
 'trim': '1.6 TDI 116 Sport 4dr S Tronic',
 'year': 2017}
2026-04-22 13:12:36 [manheim.gb] INFO: Saving data for 2103765: {'created_time': 1776247796.618989, 'last_price_update_time': 1776863556.881381}
2026-04-22 13:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_7.jpg> (referer: None)
2026-04-22 13:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_11.jpg not downloaded yet
2026-04-22 13:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_4.jpg not downloaded yet
2026-04-22 13:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_6.jpg> (referer: None)
2026-04-22 13:12:36 [manheim.gb] INFO: Found listing with ID: 2132018
2026-04-22 13:12:36 [manheim.gb] INFO: Scrape type for 2132018: 1
2026-04-22 13:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b188c6d0>
2026-04-22 13:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_4.jpg saved to cache
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d68af8f7-6990-521b-9375-da05463e8d16
2026-04-22 13:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5448375-fc22-5f48-914e-fce291265d8d with identifier: 2113720
2026-04-22 13:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5448375-fc22-5f48-914e-fce291265d8d with scrape type 2
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5448375-fc22-5f48-914e-fce291265d8d with scrape type 2
2026-04-22 13:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e5448375-fc22-5f48-914e-fce291265d8d, identifier: 2113720
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0520510>
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_7.jpg saved to cache
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0615450>
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_11.jpg saved to cache
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d68af8f7-6990-521b-9375-da05463e8d16
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1692ad0>
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_7.jpg saved to cache
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06fa050>
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_7.jpg saved to cache
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b163a450>
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_10.jpg saved to cache
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d68af8f7-6990-521b-9375-da05463e8d16
2026-04-22 13:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_9.jpg> (referer: None)
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_10.jpg not downloaded yet
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_11.jpg not downloaded yet
2026-04-22 13:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e5448375-fc22-5f48-914e-fce291265d8d with identifier: 2113720
2026-04-22 13:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e5448375-fc22-5f48-914e-fce291265d8d with identifier: 2113720
2026-04-22 13:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e5448375-fc22-5f48-914e-fce291265d8d with identifier: 2113720 to the API
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'e5448375-fc22-5f48-914e-fce291265d8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'FV13WEF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=2113720',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 80830,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-05-20',
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO 1.2 60 Match 5dr',
 'transmission': 'manual',
 'trim': '1.2 60 Match 5dr',
 'year': 2013}
2026-04-22 13:12:37 [manheim.gb] INFO: Saving data for 2113720: {'created_time': 1776247791.252471, 'last_price_update_time': 1776863557.75225}
2026-04-22 13:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_1.jpg> (referer: None)
2026-04-22 13:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:37 [manheim.gb] INFO: Found listing with ID: 2132666
2026-04-22 13:12:37 [manheim.gb] INFO: Scrape type for 2132666: 0
2026-04-22 13:12:37 [manheim.gb] INFO: Found listing with ID: 2134207
2026-04-22 13:12:37 [manheim.gb] INFO: Scrape type for 2134207: 1
2026-04-22 13:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_5.jpg> (referer: None)
2026-04-22 13:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_6.jpg> (referer: None)
2026-04-22 13:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_9.jpg not downloaded yet
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_10.jpg not downloaded yet
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b052edd0>
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_7.jpg saved to cache
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2
2026-04-22 13:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81674983-f8c8-54e4-a61e-ecebddb0ef09 with identifier: 2116878
2026-04-22 13:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81674983-f8c8-54e4-a61e-ecebddb0ef09 with scrape type 1
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 81674983-f8c8-54e4-a61e-ecebddb0ef09
2026-04-22 13:12:37 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 81674983-f8c8-54e4-a61e-ecebddb0ef09
2026-04-22 13:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 81674983-f8c8-54e4-a61e-ecebddb0ef09, identifier: 2116878
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b19bced0>
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_6.jpg saved to cache
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0
2026-04-22 13:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_2.jpg> (referer: None)
2026-04-22 13:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_1.jpg> (referer: None)
2026-04-22 13:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:38 [manheim.gb] INFO: Found listing with ID: 2134956
2026-04-22 13:12:38 [manheim.gb] INFO: Scrape type for 2134956: 1
2026-04-22 13:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 81674983-f8c8-54e4-a61e-ecebddb0ef09 with identifier: 2116878
2026-04-22 13:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 81674983-f8c8-54e4-a61e-ecebddb0ef09 with identifier: 2116878
2026-04-22 13:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 81674983-f8c8-54e4-a61e-ecebddb0ef09 with identifier: 2116878 to the API
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:38 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 81674983-f8c8-54e4-a61e-ecebddb0ef09: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:37 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:38 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:38 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Plymouth - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '81674983-f8c8-54e4-a61e-ecebddb0ef09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'GJ18XNH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2116878',
 'listing': 'auction',
 'location': 'Plymouth - In Transit',
 'longitude': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-03-30',
 'seller_name': None,
 'title': 'FORD FIESTA 1.5 TDCi 120 ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi 120 ST-Line 5dr',
 'year': 2018}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:38 [manheim.gb] INFO: Saving data for 2116878: {'created_time': 1776863558.397735, 'last_price_update_time': 1776863558.397746}
2026-04-22 13:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_5.jpg> (referer: None)
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_2.jpg not downloaded yet
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_9.jpg not downloaded yet
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b061e6d0>
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_9.jpg saved to cache
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d68af8f7-6990-521b-9375-da05463e8d16
2026-04-22 13:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_4.jpg> (referer: None)
2026-04-22 13:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:38 [manheim.gb] INFO: Found listing with ID: 2140555
2026-04-22 13:12:38 [manheim.gb] INFO: Scrape type for 2140555: 0
2026-04-22 13:12:38 [manheim.gb] INFO: Found listing with ID: 2141894
2026-04-22 13:12:38 [manheim.gb] INFO: Scrape type for 2141894: 0
2026-04-22 13:12:38 [manheim.gb] INFO: Found listing with ID: 214671
2026-04-22 13:12:38 [manheim.gb] INFO: Scrape type for 214671: 1
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_2.jpg not downloaded yet
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03d3e50>
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_1.jpg saved to cache
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0
2026-04-22 13:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6667ba41-2d6d-50a3-8892-f47d7e2756e5 with identifier: 2126881
2026-04-22 13:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6667ba41-2d6d-50a3-8892-f47d7e2756e5 with scrape type 1
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6667ba41-2d6d-50a3-8892-f47d7e2756e5
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6667ba41-2d6d-50a3-8892-f47d7e2756e5
2026-04-22 13:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6667ba41-2d6d-50a3-8892-f47d7e2756e5, identifier: 2126881
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1729bd0>
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_5.jpg saved to cache
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03d1150>
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_6.jpg saved to cache
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2
2026-04-22 13:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27d82710-a68f-59e0-a4ce-0171dabee4d5 with identifier: 2130963
2026-04-22 13:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27d82710-a68f-59e0-a4ce-0171dabee4d5 with scrape type 1
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27d82710-a68f-59e0-a4ce-0171dabee4d5
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_7.jpg not downloaded yet
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0520d50>
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_2.jpg saved to cache
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d68af8f7-6990-521b-9375-da05463e8d16
2026-04-22 13:12:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d68af8f7-6990-521b-9375-da05463e8d16, skipping ID generation
2026-04-22 13:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68af8f7-6990-521b-9375-da05463e8d16 with scrape type 1
2026-04-22 13:12:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d68af8f7-6990-521b-9375-da05463e8d16 sending to next pipeline
2026-04-22 13:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d68af8f7-6990-521b-9375-da05463e8d16, identifier: 2016547
2026-04-22 13:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14c7d90>
2026-04-22 13:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_1.jpg saved to cache
2026-04-22 13:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2
2026-04-22 13:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19366e13-1753-5ce2-b753-bc72142fb89e with identifier: 2130964
2026-04-22 13:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19366e13-1753-5ce2-b753-bc72142fb89e with scrape type 1
2026-04-22 13:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19366e13-1753-5ce2-b753-bc72142fb89e
2026-04-22 13:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_7.jpg not downloaded yet
2026-04-22 13:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_4.jpg> (referer: None)
2026-04-22 13:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_10.jpg> (referer: None)
2026-04-22 13:12:39 [manheim.gb] INFO: Found listing with ID: 2149243
2026-04-22 13:12:39 [manheim.gb] INFO: Scrape type for 2149243: 0
2026-04-22 13:12:39 [manheim.gb] INFO: Found listing with ID: 2151556
2026-04-22 13:12:39 [manheim.gb] INFO: Scrape type for 2151556: 0
2026-04-22 13:12:39 [manheim.gb] INFO: Found listing with ID: 2158935
2026-04-22 13:12:39 [manheim.gb] INFO: Scrape type for 2158935: 1
2026-04-22 13:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6667ba41-2d6d-50a3-8892-f47d7e2756e5 with identifier: 2126881
2026-04-22 13:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6667ba41-2d6d-50a3-8892-f47d7e2756e5 with identifier: 2126881
2026-04-22 13:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 6667ba41-2d6d-50a3-8892-f47d7e2756e5 with identifier: 2126881 to the API
2026-04-22 13:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'White',
 'currency': 'GBP',
 'engine': '1.7L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '6667ba41-2d6d-50a3-8892-f47d7e2756e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'EN13VNA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/I40?id=2126881',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'HYUNDAI',
 'model': 'I40',
 'odometer': 127061,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-08-05',
 'seller_name': None,
 'title': 'HYUNDAI I40 1.7 CRDi [136] Blue Drive Style 4dr',
 'transmission': 'manual',
 'trim': '1.7 CRDi [136] Blue Drive Style 4dr',
 'year': 2013}
2026-04-22 13:12:39 [manheim.gb] INFO: Saving data for 2126881: {'created_time': 1776863559.480059, 'last_price_update_time': 1776863559.480072}
2026-04-22 13:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d68af8f7-6990-521b-9375-da05463e8d16 with identifier: 2016547
2026-04-22 13:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d68af8f7-6990-521b-9375-da05463e8d16 with identifier: 2016547
2026-04-22 13:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: d68af8f7-6990-521b-9375-da05463e8d16 with identifier: 2016547 to the API
2026-04-22 13:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Plymouth',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'd68af8f7-6990-521b-9375-da05463e8d16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WF17HVR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/1%20SERIES?id=2016547',
 'listing': 'auction',
 'location': 'Plymouth',
 'longitude': None,
 'make': 'BMW',
 'model': '1 SERIES',
 'odometer': 97842,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202148,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202148,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236255,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286031,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203685,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198828,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198889,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193760,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186315,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68af8f7-6990-521b-9375-da05463e8d16/d68af8f7-6990-521b-9375-da05463e8d16_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306375,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e6c2806c-99c6-4fd5-82f9-be930a0c2a79_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-31',
 'seller_name': None,
 'title': 'BMW 1 SERIES 125d M Sport 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '125d M Sport 5dr Step Auto',
 'year': 2017}
2026-04-22 13:12:39 [manheim.gb] INFO: Saving data for 2016547: {'created_time': 1776863559.945829, 'last_price_update_time': 1776863559.945838}
2026-04-22 13:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_11.jpg> (referer: None)
2026-04-22 13:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_11.jpg> (referer: None)
2026-04-22 13:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_7.jpg not downloaded yet
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_7.jpg not downloaded yet
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0faacd0>
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_5.jpg saved to cache
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2
2026-04-22 13:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:40 [manheim.gb] INFO: Found listing with ID: 2161873
2026-04-22 13:12:40 [manheim.gb] INFO: Scrape type for 2161873: 1
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06142d0>
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_4.jpg saved to cache
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0
2026-04-22 13:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e0430e4-db7d-5bb3-adee-ed1115fedd25 with identifier: 2132018
2026-04-22 13:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e0430e4-db7d-5bb3-adee-ed1115fedd25 with scrape type 1
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 8e0430e4-db7d-5bb3-adee-ed1115fedd25
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 8e0430e4-db7d-5bb3-adee-ed1115fedd25
2026-04-22 13:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8e0430e4-db7d-5bb3-adee-ed1115fedd25, identifier: 2132018
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_6.jpg not downloaded yet
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_6.jpg not downloaded yet
2026-04-22 13:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8e0430e4-db7d-5bb3-adee-ed1115fedd25 with identifier: 2132018
2026-04-22 13:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8e0430e4-db7d-5bb3-adee-ed1115fedd25 with identifier: 2132018
2026-04-22 13:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8e0430e4-db7d-5bb3-adee-ed1115fedd25 with identifier: 2132018 to the API
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:40 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 8e0430e4-db7d-5bb3-adee-ed1115fedd25: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:40 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:40 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:40 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '8e0430e4-db7d-5bb3-adee-ed1115fedd25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WV15LXN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2132018',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-03-01',
 'seller_name': None,
 'title': 'FIAT 500 1.2 Lounge 3dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.2 Lounge 3dr [Start Stop]',
 'year': 2015}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:40 [manheim.gb] INFO: Saving data for 2132018: {'created_time': 1776863560.555362, 'last_price_update_time': 1776863560.555374}
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04f5e90>
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_4.jpg saved to cache
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16d82d0>
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_10.jpg saved to cache
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0
2026-04-22 13:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_10.jpg> (referer: None)
2026-04-22 13:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_9.jpg> (referer: None)
2026-04-22 13:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:40 [manheim.gb] INFO: Found listing with ID: 2174138
2026-04-22 13:12:40 [manheim.gb] INFO: Scrape type for 2174138: 0
2026-04-22 13:12:40 [manheim.gb] INFO: Found listing with ID: 2178111
2026-04-22 13:12:40 [manheim.gb] INFO: Scrape type for 2178111: 0
2026-04-22 13:12:40 [manheim.gb] INFO: Found listing with ID: 2179248
2026-04-22 13:12:40 [manheim.gb] INFO: Scrape type for 2179248: 0
2026-04-22 13:12:40 [manheim.gb] INFO: Found listing with ID: 2186610
2026-04-22 13:12:40 [manheim.gb] INFO: Scrape type for 2186610: 0
2026-04-22 13:12:40 [manheim.gb] INFO: Found listing with ID: 2190852
2026-04-22 13:12:40 [manheim.gb] INFO: Scrape type for 2190852: 1
2026-04-22 13:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_2.jpg> (referer: None)
2026-04-22 13:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_9.jpg> (referer: None)
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_1.jpg not downloaded yet
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_1.jpg not downloaded yet
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1775850>
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_11.jpg saved to cache
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b057a690>
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_11.jpg saved to cache
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2
2026-04-22 13:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23a01838-8cc4-5235-acda-fa73ee45c172 with identifier: 2134207
2026-04-22 13:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23a01838-8cc4-5235-acda-fa73ee45c172 with scrape type 1
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 23a01838-8cc4-5235-acda-fa73ee45c172
2026-04-22 13:12:40 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 23a01838-8cc4-5235-acda-fa73ee45c172
2026-04-22 13:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 23a01838-8cc4-5235-acda-fa73ee45c172, identifier: 2134207
2026-04-22 13:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31457d8d-412f-5eeb-86de-e9c2de730306 with identifier: 2134956
2026-04-22 13:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31457d8d-412f-5eeb-86de-e9c2de730306 with scrape type 1
2026-04-22 13:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 31457d8d-412f-5eeb-86de-e9c2de730306
2026-04-22 13:12:41 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 31457d8d-412f-5eeb-86de-e9c2de730306
2026-04-22 13:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 31457d8d-412f-5eeb-86de-e9c2de730306, identifier: 2134956
2026-04-22 13:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_7.jpg> (referer: None)
2026-04-22 13:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:41 [manheim.gb] INFO: Found listing with ID: 2191497
2026-04-22 13:12:41 [manheim.gb] INFO: Scrape type for 2191497: 1
2026-04-22 13:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 23a01838-8cc4-5235-acda-fa73ee45c172 with identifier: 2134207
2026-04-22 13:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 23a01838-8cc4-5235-acda-fa73ee45c172 with identifier: 2134207
2026-04-22 13:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 23a01838-8cc4-5235-acda-fa73ee45c172 with identifier: 2134207 to the API
2026-04-22 13:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '23a01838-8cc4-5235-acda-fa73ee45c172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'CE67OBU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=2134207',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 76312,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-10-11',
 'seller_name': None,
 'title': 'PEUGEOT 3008 2.0 BlueHDi 180 GT 5dr EAT6',
 'transmission': 'automatic',
 'trim': '2.0 BlueHDi 180 GT 5dr EAT6',
 'year': 2017}
2026-04-22 13:12:41 [manheim.gb] INFO: Saving data for 2134207: {'created_time': 1776863561.566299, 'last_price_update_time': 1776863561.56631}
2026-04-22 13:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 31457d8d-412f-5eeb-86de-e9c2de730306 with identifier: 2134956
2026-04-22 13:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 31457d8d-412f-5eeb-86de-e9c2de730306 with identifier: 2134956
2026-04-22 13:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 31457d8d-412f-5eeb-86de-e9c2de730306 with identifier: 2134956 to the API
2026-04-22 13:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:41 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 31457d8d-412f-5eeb-86de-e9c2de730306: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:41 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:41 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:41 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '31457d8d-412f-5eeb-86de-e9c2de730306',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BW67WEA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2134956',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-02-24',
 'seller_name': None,
 'title': 'FORD FIESTA 1.0 EcoBoost 125 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Titanium 5dr',
 'year': 2018}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:41 [manheim.gb] INFO: Saving data for 2134956: {'created_time': 1776863561.897647, 'last_price_update_time': 1776863561.897657}
2026-04-22 13:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_7.jpg> (referer: None)
2026-04-22 13:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_5.jpg not downloaded yet
2026-04-22 13:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_5.jpg not downloaded yet
2026-04-22 13:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_2.jpg> (referer: None)
2026-04-22 13:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:41 [manheim.gb] INFO: Found listing with ID: 219242
2026-04-22 13:12:41 [manheim.gb] INFO: Scrape type for 219242: 1
2026-04-22 13:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14daa50>
2026-04-22 13:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_10.jpg saved to cache
2026-04-22 13:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2
2026-04-22 13:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fa42d0>
2026-04-22 13:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_9.jpg saved to cache
2026-04-22 13:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0
2026-04-22 13:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c3174d1-0c66-5296-8f0a-0d472b56b3c8 with identifier: 214671
2026-04-22 13:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c3174d1-0c66-5296-8f0a-0d472b56b3c8 with scrape type 1
2026-04-22 13:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 9c3174d1-0c66-5296-8f0a-0d472b56b3c8
2026-04-22 13:12:42 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 9c3174d1-0c66-5296-8f0a-0d472b56b3c8
2026-04-22 13:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9c3174d1-0c66-5296-8f0a-0d472b56b3c8, identifier: 214671
2026-04-22 13:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1704990>
2026-04-22 13:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_2.jpg saved to cache
2026-04-22 13:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0
2026-04-22 13:12:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0, skipping ID generation
2026-04-22 13:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0 with scrape type 1
2026-04-22 13:12:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0 sending to next pipeline
2026-04-22 13:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0, identifier: 2055375
2026-04-22 13:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0ff37d0>
2026-04-22 13:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_9.jpg saved to cache
2026-04-22 13:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2
2026-04-22 13:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_7.jpg> (referer: None)
2026-04-22 13:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_4.jpg not downloaded yet
2026-04-22 13:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_4.jpg not downloaded yet
2026-04-22 13:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9c3174d1-0c66-5296-8f0a-0d472b56b3c8 with identifier: 214671
2026-04-22 13:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9c3174d1-0c66-5296-8f0a-0d472b56b3c8 with identifier: 214671
2026-04-22 13:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9c3174d1-0c66-5296-8f0a-0d472b56b3c8 with identifier: 214671 to the API
2026-04-22 13:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '9c3174d1-0c66-5296-8f0a-0d472b56b3c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'LB12ZWE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/COUNTRYMAN?id=214671',
 'listing': 'auction',
 'location': 'Washington',
 'longitude': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 118167,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2012-07-24',
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.6 Cooper D 5dr',
 'transmission': 'manual',
 'trim': '1.6 Cooper D 5dr',
 'year': 2012}
2026-04-22 13:12:42 [manheim.gb] INFO: Saving data for 214671: {'created_time': 1776863562.741425, 'last_price_update_time': 1776863562.741435}
2026-04-22 13:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0 with identifier: 2055375
2026-04-22 13:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0 with identifier: 2055375
2026-04-22 13:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0 with identifier: 2055375 to the API
2026-04-22 13:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YY61ABF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/Q5?id=2055375',
 'listing': 'auction',
 'location': 'Manchester',
 'longitude': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 137064,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202938,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202938,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241078,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172824,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212065,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199243,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214386,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193526,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197536,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0/4bba72f3-ad44-5f6c-9f84-3bab6f5af4b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239592,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64fe44d8-5175-4b76-b957-f9b14084bf49_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2011-10-08',
 'seller_name': None,
 'title': 'AUDI Q5 2.0 TDI Quattro SE 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TDI Quattro SE 5dr S Tronic',
 'year': 2011}
2026-04-22 13:12:43 [manheim.gb] INFO: Saving data for 2055375: {'created_time': 1776863563.098416, 'last_price_update_time': 1776863563.098426}
2026-04-22 13:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b066c610>
2026-04-22 13:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_7.jpg saved to cache
2026-04-22 13:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19366e13-1753-5ce2-b753-bc72142fb89e
2026-04-22 13:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 922aab96-02b7-5b71-a60c-772ca1d19fe3 with identifier: 2158935
2026-04-22 13:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 922aab96-02b7-5b71-a60c-772ca1d19fe3 with scrape type 1
2026-04-22 13:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 922aab96-02b7-5b71-a60c-772ca1d19fe3
2026-04-22 13:12:43 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 922aab96-02b7-5b71-a60c-772ca1d19fe3
2026-04-22 13:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 922aab96-02b7-5b71-a60c-772ca1d19fe3, identifier: 2158935
2026-04-22 13:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_7.jpg> (referer: None)
2026-04-22 13:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:43 [manheim.gb] INFO: Found listing with ID: 2193301
2026-04-22 13:12:43 [manheim.gb] INFO: Scrape type for 2193301: 1
2026-04-22 13:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 922aab96-02b7-5b71-a60c-772ca1d19fe3 with identifier: 2158935
2026-04-22 13:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 922aab96-02b7-5b71-a60c-772ca1d19fe3 with identifier: 2158935
2026-04-22 13:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 922aab96-02b7-5b71-a60c-772ca1d19fe3 with identifier: 2158935 to the API
2026-04-22 13:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:43 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 922aab96-02b7-5b71-a60c-772ca1d19fe3: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:43 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:43 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:43 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '922aab96-02b7-5b71-a60c-772ca1d19fe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BK68YZF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HONDA/CIVIC?id=2158935',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'HONDA',
 'model': 'CIVIC',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-10-11',
 'seller_name': None,
 'title': 'HONDA CIVIC 1.0 VTEC Turbo 126 SR 5dr',
 'transmission': 'manual',
 'trim': '1.0 VTEC Turbo 126 SR 5dr',
 'year': 2018}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:43 [manheim.gb] INFO: Saving data for 2158935: {'created_time': 1776863563.609518, 'last_price_update_time': 1776863563.609529}
2026-04-22 13:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_11.jpg not downloaded yet
2026-04-22 13:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_11.jpg not downloaded yet
2026-04-22 13:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05d8110>
2026-04-22 13:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_7.jpg saved to cache
2026-04-22 13:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27d82710-a68f-59e0-a4ce-0171dabee4d5
2026-04-22 13:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fb5010>
2026-04-22 13:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_2.jpg saved to cache
2026-04-22 13:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2
2026-04-22 13:12:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb1dca0b-810d-5cb9-86ce-d9f68facc4f2, skipping ID generation
2026-04-22 13:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2 with scrape type 1
2026-04-22 13:12:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb1dca0b-810d-5cb9-86ce-d9f68facc4f2 sending to next pipeline
2026-04-22 13:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: eb1dca0b-810d-5cb9-86ce-d9f68facc4f2, identifier: 206629
2026-04-22 13:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 816346d6-1bb1-5844-a1c1-a3065f67bd35 with identifier: 2161873
2026-04-22 13:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 816346d6-1bb1-5844-a1c1-a3065f67bd35 with scrape type 1
2026-04-22 13:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 816346d6-1bb1-5844-a1c1-a3065f67bd35
2026-04-22 13:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2161873-4166970-13.jpg not downloaded yet
2026-04-22 13:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_6.jpg> (referer: None)
2026-04-22 13:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_6.jpg> (referer: None)
2026-04-22 13:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:43 [manheim.gb] INFO: Found listing with ID: 2194436
2026-04-22 13:12:43 [manheim.gb] INFO: Scrape type for 2194436: 1
2026-04-22 13:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: eb1dca0b-810d-5cb9-86ce-d9f68facc4f2 with identifier: 206629
2026-04-22 13:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: eb1dca0b-810d-5cb9-86ce-d9f68facc4f2 with identifier: 206629
2026-04-22 13:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: eb1dca0b-810d-5cb9-86ce-d9f68facc4f2 with identifier: 206629 to the API
2026-04-22 13:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'eb1dca0b-810d-5cb9-86ce-d9f68facc4f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'GL64OZC',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF%20SV?id=206629',
 'listing': 'auction',
 'location': 'Northampton',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF SV',
 'odometer': 100971,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234250,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234250,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235154,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287727,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220352,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217997,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228494,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225472,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232773,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb1dca0b-810d-5cb9-86ce-d9f68facc4f2/eb1dca0b-810d-5cb9-86ce-d9f68facc4f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319762,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d0c58dce-65fc-4476-bddc-d047ec08b724_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-12-12',
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF SV 1.2 TSI 110 S 5dr',
 'transmission': 'manual',
 'trim': '1.2 TSI 110 S 5dr',
 'year': 2014}
2026-04-22 13:12:44 [manheim.gb] INFO: Saving data for 206629: {'created_time': 1776863564.308821, 'last_price_update_time': 1776863564.308834}
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04f1fd0>
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_7.jpg saved to cache
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19366e13-1753-5ce2-b753-bc72142fb89e
2026-04-22 13:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_1.jpg> (referer: None)
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_10.jpg not downloaded yet
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_10.jpg not downloaded yet
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_7.jpg not downloaded yet
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1094290>
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_7.jpg saved to cache
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27d82710-a68f-59e0-a4ce-0171dabee4d5
2026-04-22 13:12:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b548631d-4075-5a29-be0d-4d70179f04e2 with identifier: 2190852
2026-04-22 13:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b548631d-4075-5a29-be0d-4d70179f04e2 with scrape type 1
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b548631d-4075-5a29-be0d-4d70179f04e2
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2190852-4162978-13.jpg not downloaded yet
2026-04-22 13:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_1.jpg> (referer: None)
2026-04-22 13:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:44 [manheim.gb] INFO: Found listing with ID: 2205819
2026-04-22 13:12:44 [manheim.gb] INFO: Scrape type for 2205819: 0
2026-04-22 13:12:44 [manheim.gb] INFO: Found listing with ID: 2211212
2026-04-22 13:12:44 [manheim.gb] INFO: Scrape type for 2211212: 0
2026-04-22 13:12:44 [manheim.gb] INFO: Found listing with ID: 2214440
2026-04-22 13:12:44 [manheim.gb] INFO: Scrape type for 2214440: 0
2026-04-22 13:12:44 [manheim.gb] INFO: Found listing with ID: 2216200
2026-04-22 13:12:44 [manheim.gb] INFO: Scrape type for 2216200: 1
2026-04-22 13:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_5.jpg> (referer: None)
2026-04-22 13:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_5.jpg> (referer: None)
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_9.jpg not downloaded yet
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_9.jpg not downloaded yet
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_7.jpg not downloaded yet
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_7.jpg not downloaded yet
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1629590>
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_6.jpg saved to cache
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27d82710-a68f-59e0-a4ce-0171dabee4d5
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0617ad0>
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_6.jpg saved to cache
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19366e13-1753-5ce2-b753-bc72142fb89e
2026-04-22 13:12:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0780de74-6f56-586f-99c3-a1f5fa341933 with identifier: 2191497
2026-04-22 13:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0780de74-6f56-586f-99c3-a1f5fa341933 with scrape type 1
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 0780de74-6f56-586f-99c3-a1f5fa341933
2026-04-22 13:12:44 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 0780de74-6f56-586f-99c3-a1f5fa341933
2026-04-22 13:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0780de74-6f56-586f-99c3-a1f5fa341933, identifier: 2191497
2026-04-22 13:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_4.jpg> (referer: None)
2026-04-22 13:12:44 [manheim.gb] INFO: Found listing with ID: 2217645
2026-04-22 13:12:44 [manheim.gb] INFO: Scrape type for 2217645: 0
2026-04-22 13:12:44 [manheim.gb] INFO: Found listing with ID: 2221337
2026-04-22 13:12:44 [manheim.gb] INFO: Scrape type for 2221337: 0
2026-04-22 13:12:44 [manheim.gb] INFO: Found listing with ID: 2223843
2026-04-22 13:12:44 [manheim.gb] INFO: Scrape type for 2223843: 0
2026-04-22 13:12:44 [manheim.gb] INFO: Found listing with ID: 2224645
2026-04-22 13:12:44 [manheim.gb] INFO: Scrape type for 2224645: 0
2026-04-22 13:12:44 [manheim.gb] INFO: Found listing with ID: 2231838
2026-04-22 13:12:44 [manheim.gb] INFO: Scrape type for 2231838: 0
2026-04-22 13:12:44 [manheim.gb] INFO: Found listing with ID: 2232566
2026-04-22 13:12:44 [manheim.gb] INFO: Scrape type for 2232566: 1
2026-04-22 13:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0780de74-6f56-586f-99c3-a1f5fa341933 with identifier: 2191497
2026-04-22 13:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0780de74-6f56-586f-99c3-a1f5fa341933 with identifier: 2191497
2026-04-22 13:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0780de74-6f56-586f-99c3-a1f5fa341933 with identifier: 2191497 to the API
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:45 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 0780de74-6f56-586f-99c3-a1f5fa341933: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:44 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:45 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:45 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '0780de74-6f56-586f-99c3-a1f5fa341933',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'FP15TKD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=2191497',
 'listing': 'auction',
 'location': 'Manchester - In Transit',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'ASTRA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-05-07',
 'seller_name': None,
 'title': 'VAUXHALL ASTRA 1.6 CDTi 16V ecoFLEX Tech Line 5dr',
 'transmission': 'manual',
 'trim': '1.6 CDTi 16V ecoFLEX Tech Line 5dr',
 'year': 2015}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:45 [manheim.gb] INFO: Saving data for 2191497: {'created_time': 1776863565.274488, 'last_price_update_time': 1776863565.274503}
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b102f010>
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_1.jpg saved to cache
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19366e13-1753-5ce2-b753-bc72142fb89e
2026-04-22 13:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_4.jpg> (referer: None)
2026-04-22 13:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_2.jpg not downloaded yet
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_2.jpg not downloaded yet
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_6.jpg not downloaded yet
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_7.jpg not downloaded yet
2026-04-22 13:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:45 [manheim.gb] INFO: Found listing with ID: 2236917
2026-04-22 13:12:45 [manheim.gb] INFO: Scrape type for 2236917: 0
2026-04-22 13:12:45 [manheim.gb] INFO: Found listing with ID: 2237520
2026-04-22 13:12:45 [manheim.gb] INFO: Scrape type for 2237520: 0
2026-04-22 13:12:45 [manheim.gb] INFO: Found listing with ID: 2247165
2026-04-22 13:12:45 [manheim.gb] INFO: Scrape type for 2247165: 1
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14ce250>
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_1.jpg saved to cache
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27d82710-a68f-59e0-a4ce-0171dabee4d5
2026-04-22 13:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebf72445-9eec-5f52-8f82-a3ec3cad868f with identifier: 219242
2026-04-22 13:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebf72445-9eec-5f52-8f82-a3ec3cad868f with scrape type 1
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ebf72445-9eec-5f52-8f82-a3ec3cad868f
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_7.jpg not downloaded yet
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fad350>
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_5.jpg saved to cache
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27d82710-a68f-59e0-a4ce-0171dabee4d5
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1632350>
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_5.jpg saved to cache
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19366e13-1753-5ce2-b753-bc72142fb89e
2026-04-22 13:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2161873-4166970-13.jpg> (referer: None)
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_1.jpg not downloaded yet
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_6.jpg not downloaded yet
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1677310>
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_4.jpg saved to cache
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19366e13-1753-5ce2-b753-bc72142fb89e
2026-04-22 13:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_11.jpg> (referer: None)
2026-04-22 13:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_11.jpg> (referer: None)
2026-04-22 13:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_10.jpg> (referer: None)
2026-04-22 13:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:45 [manheim.gb] INFO: Found listing with ID: 2251610
2026-04-22 13:12:45 [manheim.gb] INFO: Scrape type for 2251610: 1
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_7.jpg not downloaded yet
2026-04-22 13:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_7.jpg> (referer: None)
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_5.jpg not downloaded yet
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_1.jpg not downloaded yet
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b15be6d0>
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_4.jpg saved to cache
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27d82710-a68f-59e0-a4ce-0171dabee4d5
2026-04-22 13:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 993ed375-6829-5846-afe2-5f724f250b04 with identifier: 2193301
2026-04-22 13:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 993ed375-6829-5846-afe2-5f724f250b04 with scrape type 1
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 993ed375-6829-5846-afe2-5f724f250b04
2026-04-22 13:12:45 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 993ed375-6829-5846-afe2-5f724f250b04
2026-04-22 13:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 993ed375-6829-5846-afe2-5f724f250b04, identifier: 2193301
2026-04-22 13:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae574d52-d585-5481-a6ad-ef16ccbadcfe with identifier: 2194436
2026-04-22 13:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae574d52-d585-5481-a6ad-ef16ccbadcfe with scrape type 1
2026-04-22 13:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ae574d52-d585-5481-a6ad-ef16ccbadcfe
2026-04-22 13:12:46 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ae574d52-d585-5481-a6ad-ef16ccbadcfe
2026-04-22 13:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ae574d52-d585-5481-a6ad-ef16ccbadcfe, identifier: 2194436
2026-04-22 13:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_10.jpg> (referer: None)
2026-04-22 13:12:46 [manheim.gb] INFO: Found listing with ID: 2254839
2026-04-22 13:12:46 [manheim.gb] INFO: Scrape type for 2254839: 1
2026-04-22 13:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_6.jpg not downloaded yet
2026-04-22 13:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 993ed375-6829-5846-afe2-5f724f250b04 with identifier: 2193301
2026-04-22 13:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 993ed375-6829-5846-afe2-5f724f250b04 with identifier: 2193301
2026-04-22 13:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 993ed375-6829-5846-afe2-5f724f250b04 with identifier: 2193301 to the API
2026-04-22 13:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:46 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 993ed375-6829-5846-afe2-5f724f250b04: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:46 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:46 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:46 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '993ed375-6829-5846-afe2-5f724f250b04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KY68HLX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=2193301',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-09-13',
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PureTech Allure Premium 5dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure Premium 5dr [Start Stop]',
 'year': 2018}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:46 [manheim.gb] INFO: Saving data for 2193301: {'created_time': 1776863566.532832, 'last_price_update_time': 1776863566.532849}
2026-04-22 13:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ae574d52-d585-5481-a6ad-ef16ccbadcfe with identifier: 2194436
2026-04-22 13:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ae574d52-d585-5481-a6ad-ef16ccbadcfe with identifier: 2194436
2026-04-22 13:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ae574d52-d585-5481-a6ad-ef16ccbadcfe with identifier: 2194436 to the API
2026-04-22 13:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:46 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id ae574d52-d585-5481-a6ad-ef16ccbadcfe: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:46 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:46 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:46 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'ae574d52-d585-5481-a6ad-ef16ccbadcfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WX67XUR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/GL?id=2194436',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GL',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-09-30',
 'seller_name': None,
 'title': 'MERCEDES-BENZ GL GLE 350d 4Matic AMG Line 5dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'GLE 350d 4Matic AMG Line 5dr 9G-Tronic',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:46 [manheim.gb] INFO: Saving data for 2194436: {'created_time': 1776863566.838549, 'last_price_update_time': 1776863566.83856}
2026-04-22 13:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2190852-4162978-13.jpg> (referer: None)
2026-04-22 13:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_4.jpg not downloaded yet
2026-04-22 13:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_5.jpg not downloaded yet
2026-04-22 13:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0680ad0>
2026-04-22 13:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2161873-4166970-13.jpg saved to cache
2026-04-22 13:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 816346d6-1bb1-5844-a1c1-a3065f67bd35
2026-04-22 13:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_7.jpg> (referer: None)
2026-04-22 13:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:46 [scrapy.extensions.logstats] INFO: Crawled 145 pages (at 84 pages/min), scraped 70 items (at 48 items/min)
2026-04-22 13:12:46 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-04-22 13:12:46 [manheim.gb] INFO: Found listing with ID: 2254856
2026-04-22 13:12:47 [manheim.gb] INFO: Scrape type for 2254856: 0
2026-04-22 13:12:47 [manheim.gb] INFO: Found listing with ID: 2257214
2026-04-22 13:12:47 [manheim.gb] INFO: Scrape type for 2257214: 1
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_1.jpg not downloaded yet
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b076a090>
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_11.jpg saved to cache
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27d82710-a68f-59e0-a4ce-0171dabee4d5
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fae810>
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_11.jpg saved to cache
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19366e13-1753-5ce2-b753-bc72142fb89e
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06e2fd0>
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_10.jpg saved to cache
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19366e13-1753-5ce2-b753-bc72142fb89e
2026-04-22 13:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceec2221-2c83-5cbb-a698-d3b774ebd58d with identifier: 2216200
2026-04-22 13:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceec2221-2c83-5cbb-a698-d3b774ebd58d with scrape type 1
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ceec2221-2c83-5cbb-a698-d3b774ebd58d
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216200-4162592-13.jpg not downloaded yet
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03ab090>
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_7.jpg saved to cache
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 816346d6-1bb1-5844-a1c1-a3065f67bd35
2026-04-22 13:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_9.jpg> (referer: None)
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_11.jpg not downloaded yet
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_4.jpg not downloaded yet
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1704450>
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_10.jpg saved to cache
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27d82710-a68f-59e0-a4ce-0171dabee4d5
2026-04-22 13:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_7.jpg> (referer: None)
2026-04-22 13:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_9.jpg> (referer: None)
2026-04-22 13:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_7.jpg> (referer: None)
2026-04-22 13:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:47 [manheim.gb] INFO: Found listing with ID: 2259008
2026-04-22 13:12:47 [manheim.gb] INFO: Scrape type for 2259008: 0
2026-04-22 13:12:47 [manheim.gb] INFO: Found listing with ID: 2262256
2026-04-22 13:12:47 [manheim.gb] INFO: Scrape type for 2262256: 0
2026-04-22 13:12:47 [manheim.gb] INFO: Found listing with ID: 2264606
2026-04-22 13:12:47 [manheim.gb] INFO: Scrape type for 2264606: 1
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_5.jpg not downloaded yet
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_7.jpg not downloaded yet
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b100b950>
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2190852-4162978-13.jpg saved to cache
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b548631d-4075-5a29-be0d-4d70179f04e2
2026-04-22 13:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9d9afe0-ef13-5f14-a922-9b5f2eef119d with identifier: 2232566
2026-04-22 13:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9d9afe0-ef13-5f14-a922-9b5f2eef119d with scrape type 1
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e9d9afe0-ef13-5f14-a922-9b5f2eef119d
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e9d9afe0-ef13-5f14-a922-9b5f2eef119d
2026-04-22 13:12:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e9d9afe0-ef13-5f14-a922-9b5f2eef119d, identifier: 2232566
2026-04-22 13:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_6.jpg> (referer: None)
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_10.jpg not downloaded yet
2026-04-22 13:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_11.jpg not downloaded yet
2026-04-22 13:12:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e9d9afe0-ef13-5f14-a922-9b5f2eef119d with identifier: 2232566
2026-04-22 13:12:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e9d9afe0-ef13-5f14-a922-9b5f2eef119d with identifier: 2232566
2026-04-22 13:12:47 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e9d9afe0-ef13-5f14-a922-9b5f2eef119d with identifier: 2232566 to the API
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'e9d9afe0-ef13-5f14-a922-9b5f2eef119d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BW66NSY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2232566',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 52898,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-12-30',
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.5 dCi N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi N-Connecta 5dr',
 'year': 2016}
2026-04-22 13:12:47 [manheim.gb] INFO: Saving data for 2232566: {'created_time': 1776863567.944942, 'last_price_update_time': 1776863567.944954}
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03b9310>
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_7.jpg saved to cache
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b548631d-4075-5a29-be0d-4d70179f04e2
2026-04-22 13:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3a69b9a-312d-50ff-beb9-15c33d0531d3 with identifier: 2247165
2026-04-22 13:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3a69b9a-312d-50ff-beb9-15c33d0531d3 with scrape type 1
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a3a69b9a-312d-50ff-beb9-15c33d0531d3
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a3a69b9a-312d-50ff-beb9-15c33d0531d3
2026-04-22 13:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a3a69b9a-312d-50ff-beb9-15c33d0531d3, identifier: 2247165
2026-04-22 13:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:48 [manheim.gb] INFO: Found listing with ID: 226960
2026-04-22 13:12:48 [manheim.gb] INFO: Scrape type for 226960: 1
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_4.jpg not downloaded yet
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_7.jpg not downloaded yet
2026-04-22 13:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a3a69b9a-312d-50ff-beb9-15c33d0531d3 with identifier: 2247165
2026-04-22 13:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a3a69b9a-312d-50ff-beb9-15c33d0531d3 with identifier: 2247165
2026-04-22 13:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a3a69b9a-312d-50ff-beb9-15c33d0531d3 with identifier: 2247165 to the API
2026-04-22 13:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'Grey',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'a3a69b9a-312d-50ff-beb9-15c33d0531d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WU13MKM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=2247165',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 106037,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-07-09',
 'seller_name': None,
 'title': 'PEUGEOT 3008 2.0 HDi 150 Allure 5dr',
 'transmission': 'manual',
 'trim': '2.0 HDi 150 Allure 5dr',
 'year': 2013}
2026-04-22 13:12:48 [manheim.gb] INFO: Saving data for 2247165: {'created_time': 1776863568.508222, 'last_price_update_time': 1776863568.508238}
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_9.jpg not downloaded yet
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_10.jpg not downloaded yet
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0562f10>
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_9.jpg saved to cache
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 19366e13-1753-5ce2-b753-bc72142fb89e
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1714c90>
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_7.jpg saved to cache
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 816346d6-1bb1-5844-a1c1-a3065f67bd35
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b072e7d0>
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_9.jpg saved to cache
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27d82710-a68f-59e0-a4ce-0171dabee4d5
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05bba90>
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_7.jpg saved to cache
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b548631d-4075-5a29-be0d-4d70179f04e2
2026-04-22 13:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a9bd099-3612-539e-a638-280f22191e67 with identifier: 2251610
2026-04-22 13:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a9bd099-3612-539e-a638-280f22191e67 with scrape type 1
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a9bd099-3612-539e-a638-280f22191e67
2026-04-22 13:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_7.jpg not downloaded yet
2026-04-22 13:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_2.jpg> (referer: None)
2026-04-22 13:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_2.jpg> (referer: None)
2026-04-22 13:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:48 [manheim.gb] INFO: Found listing with ID: 2269691
2026-04-22 13:12:48 [manheim.gb] INFO: Scrape type for 2269691: 0
2026-04-22 13:12:48 [manheim.gb] INFO: Found listing with ID: 2271456
2026-04-22 13:12:49 [manheim.gb] INFO: Scrape type for 2271456: 1
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_11.jpg not downloaded yet
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_6.jpg not downloaded yet
2026-04-22 13:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1739c50>
2026-04-22 13:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_6.jpg saved to cache
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 816346d6-1bb1-5844-a1c1-a3065f67bd35
2026-04-22 13:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_7.jpg> (referer: None)
2026-04-22 13:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_6.jpg> (referer: None)
2026-04-22 13:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_1.jpg> (referer: None)
2026-04-22 13:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_1.jpg> (referer: None)
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_9.jpg not downloaded yet
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_7.jpg not downloaded yet
2026-04-22 13:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52d39fb7-4d7d-542a-852a-1ab248e655dd with identifier: 2254839
2026-04-22 13:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52d39fb7-4d7d-542a-852a-1ab248e655dd with scrape type 1
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 52d39fb7-4d7d-542a-852a-1ab248e655dd
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 52d39fb7-4d7d-542a-852a-1ab248e655dd
2026-04-22 13:12:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 52d39fb7-4d7d-542a-852a-1ab248e655dd, identifier: 2254839
2026-04-22 13:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_7.jpg> (referer: None)
2026-04-22 13:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_5.jpg> (referer: None)
2026-04-22 13:12:49 [manheim.gb] INFO: Found listing with ID: 2278186
2026-04-22 13:12:49 [manheim.gb] INFO: Scrape type for 2278186: 0
2026-04-22 13:12:49 [manheim.gb] INFO: Found listing with ID: 2281059
2026-04-22 13:12:49 [manheim.gb] INFO: Scrape type for 2281059: 0
2026-04-22 13:12:49 [manheim.gb] INFO: Found listing with ID: 2282075
2026-04-22 13:12:49 [manheim.gb] INFO: Scrape type for 2282075: 0
2026-04-22 13:12:49 [manheim.gb] INFO: Found listing with ID: 2283768
2026-04-22 13:12:49 [manheim.gb] INFO: Scrape type for 2283768: 1
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_10.jpg not downloaded yet
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_1.jpg not downloaded yet
2026-04-22 13:12:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 52d39fb7-4d7d-542a-852a-1ab248e655dd with identifier: 2254839
2026-04-22 13:12:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 52d39fb7-4d7d-542a-852a-1ab248e655dd with identifier: 2254839
2026-04-22 13:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 52d39fb7-4d7d-542a-852a-1ab248e655dd with identifier: 2254839 to the API
2026-04-22 13:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '0.9L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '52d39fb7-4d7d-542a-852a-1ab248e655dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BC68WLJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/CLIO?id=2254839',
 'listing': 'auction',
 'location': 'Washington',
 'longitude': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 41783,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-02-22',
 'seller_name': None,
 'title': 'RENAULT CLIO 0.9 TCE 90 Iconic 5dr',
 'transmission': 'manual',
 'trim': '0.9 TCE 90 Iconic 5dr',
 'year': 2019}
2026-04-22 13:12:49 [manheim.gb] INFO: Saving data for 2254839: {'created_time': 1776863569.686301, 'last_price_update_time': 1776863569.686312}
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_6.jpg not downloaded yet
2026-04-22 13:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04c6d90>
2026-04-22 13:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_2.jpg saved to cache
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 19366e13-1753-5ce2-b753-bc72142fb89e
2026-04-22 13:12:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19366e13-1753-5ce2-b753-bc72142fb89e, skipping ID generation
2026-04-22 13:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19366e13-1753-5ce2-b753-bc72142fb89e with scrape type 1
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19366e13-1753-5ce2-b753-bc72142fb89e sending to next pipeline
2026-04-22 13:12:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 19366e13-1753-5ce2-b753-bc72142fb89e, identifier: 2130964
2026-04-22 13:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b334b410>
2026-04-22 13:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_2.jpg saved to cache
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27d82710-a68f-59e0-a4ce-0171dabee4d5
2026-04-22 13:12:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27d82710-a68f-59e0-a4ce-0171dabee4d5, skipping ID generation
2026-04-22 13:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27d82710-a68f-59e0-a4ce-0171dabee4d5 with scrape type 1
2026-04-22 13:12:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27d82710-a68f-59e0-a4ce-0171dabee4d5 sending to next pipeline
2026-04-22 13:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 27d82710-a68f-59e0-a4ce-0171dabee4d5, identifier: 2130963
2026-04-22 13:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a00a958-1a07-5560-a111-a1bd1eb9c8c0 with identifier: 2257214
2026-04-22 13:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a00a958-1a07-5560-a111-a1bd1eb9c8c0 with scrape type 1
2026-04-22 13:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7a00a958-1a07-5560-a111-a1bd1eb9c8c0
2026-04-22 13:12:50 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7a00a958-1a07-5560-a111-a1bd1eb9c8c0
2026-04-22 13:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 7a00a958-1a07-5560-a111-a1bd1eb9c8c0, identifier: 2257214
2026-04-22 13:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:50 [manheim.gb] INFO: Found listing with ID: 2288406
2026-04-22 13:12:50 [manheim.gb] INFO: Scrape type for 2288406: 0
2026-04-22 13:12:50 [manheim.gb] INFO: Found listing with ID: 2292190
2026-04-22 13:12:50 [manheim.gb] INFO: Scrape type for 2292190: 0
2026-04-22 13:12:50 [manheim.gb] INFO: Found listing with ID: 2293902
2026-04-22 13:12:50 [manheim.gb] INFO: Scrape type for 2293902: 1
2026-04-22 13:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_9.jpg not downloaded yet
2026-04-22 13:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_5.jpg not downloaded yet
2026-04-22 13:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 19366e13-1753-5ce2-b753-bc72142fb89e with identifier: 2130964
2026-04-22 13:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:12:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2026-04-22 13:12:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 19366e13-1753-5ce2-b753-bc72142fb89e with identifier: 2130964
2026-04-22 13:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 19366e13-1753-5ce2-b753-bc72142fb89e with identifier: 2130964 to the API
2026-04-22 13:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Gloucester',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': None,
 'fuel_type': 'Electric',
 'id': '19366e13-1753-5ce2-b753-bc72142fb89e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WJ66UBN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/E-NV200?id=2130964',
 'listing': 'auction',
 'location': 'Gloucester',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'E-NV200',
 'odometer': 30821,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191094,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191094,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309144,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248831,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212555,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194557,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204023,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184027,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194660,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19366e13-1753-5ce2-b753-bc72142fb89e/19366e13-1753-5ce2-b753-bc72142fb89e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281622,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90314cd9-fcfd-4045-8ee6-3935950fa41c_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-09-27',
 'seller_name': None,
 'title': 'NISSAN E-NV200 Acenta Rapid Van Auto',
 'transmission': 'automatic',
 'trim': 'Acenta Rapid Van Auto',
 'year': 2016}
2026-04-22 13:12:50 [manheim.gb] INFO: Saving data for 2130964: {'created_time': 1776863570.816621, 'last_price_update_time': 1776863570.816634}
2026-04-22 13:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 27d82710-a68f-59e0-a4ce-0171dabee4d5 with identifier: 2130963
2026-04-22 13:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 27d82710-a68f-59e0-a4ce-0171dabee4d5 with identifier: 2130963
2026-04-22 13:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 27d82710-a68f-59e0-a4ce-0171dabee4d5 with identifier: 2130963 to the API
2026-04-22 13:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:51 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Gloucester',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': None,
 'fuel_type': 'Electric',
 'id': '27d82710-a68f-59e0-a4ce-0171dabee4d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WJ66BXH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/E-NV200?id=2130963',
 'listing': 'auction',
 'location': 'Gloucester',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'E-NV200',
 'odometer': 44202,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205930,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205930,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300542,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270474,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217498,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203515,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205602,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186754,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200600,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27d82710-a68f-59e0-a4ce-0171dabee4d5/27d82710-a68f-59e0-a4ce-0171dabee4d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311775,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0add8597-168e-4ee9-8882-48f89799f2d2_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-09-30',
 'seller_name': None,
 'title': 'NISSAN E-NV200 Acenta Rapid Van Auto',
 'transmission': 'automatic',
 'trim': 'Acenta Rapid Van Auto',
 'year': 2016}
2026-04-22 13:12:51 [manheim.gb] INFO: Saving data for 2130963: {'created_time': 1776863571.20131, 'last_price_update_time': 1776863571.201321}
2026-04-22 13:12:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 7a00a958-1a07-5560-a111-a1bd1eb9c8c0 with identifier: 2257214
2026-04-22 13:12:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 7a00a958-1a07-5560-a111-a1bd1eb9c8c0 with identifier: 2257214
2026-04-22 13:12:51 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 7a00a958-1a07-5560-a111-a1bd1eb9c8c0 with identifier: 2257214 to the API
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:51 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 7a00a958-1a07-5560-a111-a1bd1eb9c8c0: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:51 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:51 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:51 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '7a00a958-1a07-5560-a111-a1bd1eb9c8c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'AK19YXZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/ECOSPORT?id=2257214',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'FORD',
 'model': 'ECOSPORT',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-04-30',
 'seller_name': None,
 'title': 'FORD ECOSPORT 1.0 EcoBoost 125 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Titanium 5dr',
 'year': 2019}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:51 [manheim.gb] INFO: Saving data for 2257214: {'created_time': 1776863571.522045, 'last_price_update_time': 1776863571.522057}
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0f9df10>
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_7.jpg saved to cache
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebf72445-9eec-5f52-8f82-a3ec3cad868f
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b072dad0>
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_6.jpg saved to cache
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b548631d-4075-5a29-be0d-4d70179f04e2
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03b1150>
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_1.jpg saved to cache
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b548631d-4075-5a29-be0d-4d70179f04e2
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03aac90>
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_1.jpg saved to cache
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 816346d6-1bb1-5844-a1c1-a3065f67bd35
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_1.jpg not downloaded yet
2026-04-22 13:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_1.jpg> (referer: None)
2026-04-22 13:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_4.jpg> (referer: None)
2026-04-22 13:12:51 [manheim.gb] INFO: Found listing with ID: 2297817
2026-04-22 13:12:51 [manheim.gb] INFO: Scrape type for 2297817: 1
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_2.jpg not downloaded yet
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_4.jpg not downloaded yet
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0757150>
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_7.jpg saved to cache
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebf72445-9eec-5f52-8f82-a3ec3cad868f
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1020ad0>
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_5.jpg saved to cache
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 816346d6-1bb1-5844-a1c1-a3065f67bd35
2026-04-22 13:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_5.jpg> (referer: None)
2026-04-22 13:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2216200-4162592-13.jpg> (referer: None)
2026-04-22 13:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_4.jpg> (referer: None)
2026-04-22 13:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_5.jpg not downloaded yet
2026-04-22 13:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_7.jpg> (referer: None)
2026-04-22 13:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_7.jpg> (referer: None)
2026-04-22 13:12:51 [manheim.gb] INFO: Found listing with ID: 2299977
2026-04-22 13:12:51 [manheim.gb] INFO: Scrape type for 2299977: 1
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_11.jpg not downloaded yet
2026-04-22 13:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7ac3c35-61bd-5b92-ab3f-1096540676af with identifier: 226960
2026-04-22 13:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7ac3c35-61bd-5b92-ab3f-1096540676af with scrape type 1
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f7ac3c35-61bd-5b92-ab3f-1096540676af
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f7ac3c35-61bd-5b92-ab3f-1096540676af
2026-04-22 13:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f7ac3c35-61bd-5b92-ab3f-1096540676af, identifier: 226960
2026-04-22 13:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_6.jpg> (referer: None)
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_4.jpg not downloaded yet
2026-04-22 13:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f7ac3c35-61bd-5b92-ab3f-1096540676af with identifier: 226960
2026-04-22 13:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f7ac3c35-61bd-5b92-ab3f-1096540676af with identifier: 226960
2026-04-22 13:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f7ac3c35-61bd-5b92-ab3f-1096540676af with identifier: 226960 to the API
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:52 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id f7ac3c35-61bd-5b92-ab3f-1096540676af: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:51 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:52 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:52 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'f7ac3c35-61bd-5b92-ab3f-1096540676af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'RE12RYO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=226960',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2012-05-01',
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 2.0 TDi 140 BlueMotion Tech Match 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDi 140 BlueMotion Tech Match 5dr',
 'year': 2012}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:52 [manheim.gb] INFO: Saving data for 226960: {'created_time': 1776863572.434297, 'last_price_update_time': 1776863572.434307}
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b102fcd0>
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_1.jpg saved to cache
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ebf72445-9eec-5f52-8f82-a3ec3cad868f
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1714390>
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_4.jpg saved to cache
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 816346d6-1bb1-5844-a1c1-a3065f67bd35
2026-04-22 13:12:52 [manheim.gb] INFO: Found listing with ID: 2312290
2026-04-22 13:12:52 [manheim.gb] INFO: Scrape type for 2312290: 1
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_10.jpg not downloaded yet
2026-04-22 13:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_11.jpg not downloaded yet
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06f8750>
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_5.jpg saved to cache
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b548631d-4075-5a29-be0d-4d70179f04e2
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03ac610>
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216200-4162592-13.jpg saved to cache
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ceec2221-2c83-5cbb-a698-d3b774ebd58d
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03cfdd0>
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_4.jpg saved to cache
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b548631d-4075-5a29-be0d-4d70179f04e2
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04cdd50>
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_7.jpg saved to cache
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ceec2221-2c83-5cbb-a698-d3b774ebd58d
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05d2cd0>
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_7.jpg saved to cache
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ceec2221-2c83-5cbb-a698-d3b774ebd58d
2026-04-22 13:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_7.jpg> (referer: None)
2026-04-22 13:12:52 [manheim.gb] INFO: Found listing with ID: 2314543
2026-04-22 13:12:52 [manheim.gb] INFO: Scrape type for 2314543: 2
2026-04-22 13:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_9.jpg not downloaded yet
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_4.jpg> (referer: None)
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_9.jpg> (referer: None)
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_10.jpg not downloaded yet
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16865d0>
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_6.jpg saved to cache
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebf72445-9eec-5f52-8f82-a3ec3cad868f
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_10.jpg> (referer: None)
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_11.jpg> (referer: None)
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_6.jpg> (referer: None)
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_11.jpg> (referer: None)
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_1.jpg> (referer: None)
2026-04-22 13:12:53 [manheim.gb] INFO: Found listing with ID: 2318533
2026-04-22 13:12:53 [manheim.gb] INFO: Scrape type for 2318533: 1
2026-04-22 13:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7732648-c58d-5722-ba4b-19ade4918c0d with identifier: 2293902
2026-04-22 13:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7732648-c58d-5722-ba4b-19ade4918c0d with scrape type 1
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7732648-c58d-5722-ba4b-19ade4918c0d
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_7.jpg not downloaded yet
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_9.jpg not downloaded yet
2026-04-22 13:12:53 [manheim.gb] INFO: Found listing with ID: 2341406
2026-04-22 13:12:53 [manheim.gb] INFO: Scrape type for 2341406: 0
2026-04-22 13:12:53 [manheim.gb] INFO: Found listing with ID: 2343639
2026-04-22 13:12:53 [manheim.gb] INFO: Scrape type for 2343639: 0
2026-04-22 13:12:53 [manheim.gb] INFO: Found listing with ID: 2347452
2026-04-22 13:12:53 [manheim.gb] INFO: Scrape type for 2347452: 1
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_7.jpg not downloaded yet
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14daa90>
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_7.jpg saved to cache
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a9bd099-3612-539e-a638-280f22191e67
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_2.jpg not downloaded yet
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14e8410>
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_4.jpg saved to cache
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ebf72445-9eec-5f52-8f82-a3ec3cad868f
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05ce510>
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_9.jpg saved to cache
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 816346d6-1bb1-5844-a1c1-a3065f67bd35
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_5.jpg> (referer: None)
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:53 [manheim.gb] INFO: Found listing with ID: 2349491
2026-04-22 13:12:53 [manheim.gb] INFO: Scrape type for 2349491: 0
2026-04-22 13:12:53 [manheim.gb] INFO: Found listing with ID: 2356132
2026-04-22 13:12:53 [manheim.gb] INFO: Scrape type for 2356132: 1
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_6.jpg not downloaded yet
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05128d0>
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_10.jpg saved to cache
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b548631d-4075-5a29-be0d-4d70179f04e2
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03bba50>
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_11.jpg saved to cache
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b548631d-4075-5a29-be0d-4d70179f04e2
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b101e750>
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_6.jpg saved to cache
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ceec2221-2c83-5cbb-a698-d3b774ebd58d
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1079150>
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_11.jpg saved to cache
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ebf72445-9eec-5f52-8f82-a3ec3cad868f
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b069a950>
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_1.jpg saved to cache
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ceec2221-2c83-5cbb-a698-d3b774ebd58d
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_1.jpg> (referer: None)
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_1.jpg not downloaded yet
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_9.jpg> (referer: None)
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_4.jpg> (referer: None)
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_5.jpg> (referer: None)
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_4.jpg> (referer: None)
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_5.jpg not downloaded yet
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03a24d0>
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_5.jpg saved to cache
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ceec2221-2c83-5cbb-a698-d3b774ebd58d
2026-04-22 13:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfc785bf-f7bd-56c7-974f-93eaaf13ef61 with identifier: 2312290
2026-04-22 13:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfc785bf-f7bd-56c7-974f-93eaaf13ef61 with scrape type 1
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item dfc785bf-f7bd-56c7-974f-93eaaf13ef61
2026-04-22 13:12:53 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item dfc785bf-f7bd-56c7-974f-93eaaf13ef61
2026-04-22 13:12:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: dfc785bf-f7bd-56c7-974f-93eaaf13ef61, identifier: 2312290
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_2.jpg> (referer: None)
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_6.jpg> (referer: None)
2026-04-22 13:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_10.jpg> (referer: None)
2026-04-22 13:12:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: dfc785bf-f7bd-56c7-974f-93eaaf13ef61 with identifier: 2312290
2026-04-22 13:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: dfc785bf-f7bd-56c7-974f-93eaaf13ef61 with identifier: 2312290
2026-04-22 13:12:54 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: dfc785bf-f7bd-56c7-974f-93eaaf13ef61 with identifier: 2312290 to the API
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:54 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id dfc785bf-f7bd-56c7-974f-93eaaf13ef61: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:53 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:54 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:54 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'dfc785bf-f7bd-56c7-974f-93eaaf13ef61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DN59WSV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2312290',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2010-01-02',
 'seller_name': None,
 'title': 'FIAT 500 1.2 Pop 3dr',
 'transmission': 'manual',
 'trim': '1.2 Pop 3dr',
 'year': 2010}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:54 [manheim.gb] INFO: Saving data for 2312290: {'created_time': 1776863574.276027, 'last_price_update_time': 1776863574.276042}
2026-04-22 13:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_4.jpg not downloaded yet
2026-04-22 13:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b100a2d0>
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_1.jpg saved to cache
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a9bd099-3612-539e-a638-280f22191e67
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b161b790>
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_9.jpg saved to cache
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ebf72445-9eec-5f52-8f82-a3ec3cad868f
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06afb90>
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_4.jpg saved to cache
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ceec2221-2c83-5cbb-a698-d3b774ebd58d
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0674590>
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_5.jpg saved to cache
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a9bd099-3612-539e-a638-280f22191e67
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06ecd50>
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_4.jpg saved to cache
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a9bd099-3612-539e-a638-280f22191e67
2026-04-22 13:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_9.jpg> (referer: None)
2026-04-22 13:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_11.jpg> (referer: None)
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2293902-4167543-13.jpg not downloaded yet
2026-04-22 13:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_11.jpg> (referer: None)
2026-04-22 13:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_7.jpg> (referer: None)
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04fcb50>
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_2.jpg saved to cache
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ebf72445-9eec-5f52-8f82-a3ec3cad868f
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0728ed0>
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_6.jpg saved to cache
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a9bd099-3612-539e-a638-280f22191e67
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16cb110>
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_10.jpg saved to cache
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ceec2221-2c83-5cbb-a698-d3b774ebd58d
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_4.jpg not downloaded yet
2026-04-22 13:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_1.jpg> (referer: None)
2026-04-22 13:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_9.jpg> (referer: None)
2026-04-22 13:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_2.jpg> (referer: None)
2026-04-22 13:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_6.jpg> (referer: None)
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_3.jpg not downloaded yet
2026-04-22 13:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8504ed93-3b09-561a-bdd8-ab0617787ceb with identifier: 2297817
2026-04-22 13:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8504ed93-3b09-561a-bdd8-ab0617787ceb with scrape type 1
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 8504ed93-3b09-561a-bdd8-ab0617787ceb
2026-04-22 13:12:54 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 8504ed93-3b09-561a-bdd8-ab0617787ceb
2026-04-22 13:12:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8504ed93-3b09-561a-bdd8-ab0617787ceb, identifier: 2297817
2026-04-22 13:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aaf2906-58e0-5b60-84e3-db14274cdf2c with identifier: 2314543
2026-04-22 13:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aaf2906-58e0-5b60-84e3-db14274cdf2c with scrape type 2
2026-04-22 13:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aaf2906-58e0-5b60-84e3-db14274cdf2c with scrape type 2
2026-04-22 13:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4aaf2906-58e0-5b60-84e3-db14274cdf2c, identifier: 2314543
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2ab73d0>
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_9.jpg saved to cache
2026-04-22 13:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ceec2221-2c83-5cbb-a698-d3b774ebd58d
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b072b890>
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_11.jpg saved to cache
2026-04-22 13:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ceec2221-2c83-5cbb-a698-d3b774ebd58d
2026-04-22 13:12:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ceec2221-2c83-5cbb-a698-d3b774ebd58d, skipping ID generation
2026-04-22 13:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceec2221-2c83-5cbb-a698-d3b774ebd58d with scrape type 1
2026-04-22 13:12:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ceec2221-2c83-5cbb-a698-d3b774ebd58d sending to next pipeline
2026-04-22 13:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ceec2221-2c83-5cbb-a698-d3b774ebd58d, identifier: 2216200
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b172be50>
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_11.jpg saved to cache
2026-04-22 13:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a9bd099-3612-539e-a638-280f22191e67
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0ff5c10>
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_7.jpg saved to cache
2026-04-22 13:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7732648-c58d-5722-ba4b-19ade4918c0d
2026-04-22 13:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_7.jpg> (referer: None)
2026-04-22 13:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8504ed93-3b09-561a-bdd8-ab0617787ceb with identifier: 2297817
2026-04-22 13:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8504ed93-3b09-561a-bdd8-ab0617787ceb with identifier: 2297817
2026-04-22 13:12:55 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8504ed93-3b09-561a-bdd8-ab0617787ceb with identifier: 2297817 to the API
2026-04-22 13:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '8504ed93-3b09-561a-bdd8-ab0617787ceb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DU66UZT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/MOKKA?id=2297817',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'MOKKA',
 'odometer': 91241,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-09-06',
 'seller_name': None,
 'title': 'VAUXHALL MOKKA 1.4T Exclusiv 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.4T Exclusiv 5dr Auto',
 'year': 2016}
2026-04-22 13:12:55 [manheim.gb] INFO: Saving data for 2297817: {'created_time': 1776863575.762844, 'last_price_update_time': 1776863575.762856}
2026-04-22 13:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4aaf2906-58e0-5b60-84e3-db14274cdf2c with identifier: 2314543
2026-04-22 13:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4aaf2906-58e0-5b60-84e3-db14274cdf2c with identifier: 2314543
2026-04-22 13:12:55 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 4aaf2906-58e0-5b60-84e3-db14274cdf2c with identifier: 2314543 to the API
2026-04-22 13:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '4aaf2906-58e0-5b60-84e3-db14274cdf2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KJ68MWF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=2314543',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 57963,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-02-08',
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PureTech 130 GT Line 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 GT Line 5dr',
 'year': 2019}
2026-04-22 13:12:56 [manheim.gb] INFO: Saving data for 2314543: {'created_time': 1776247792.002492, 'last_price_update_time': 1776863576.149037}
2026-04-22 13:12:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ceec2221-2c83-5cbb-a698-d3b774ebd58d with identifier: 2216200
2026-04-22 13:12:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ceec2221-2c83-5cbb-a698-d3b774ebd58d with identifier: 2216200
2026-04-22 13:12:56 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ceec2221-2c83-5cbb-a698-d3b774ebd58d with identifier: 2216200 to the API
2026-04-22 13:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:56 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_11.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'ceec2221-2c83-5cbb-a698-d3b774ebd58d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DE64VVL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/GRAND%20C4%20PICASSO?id=2216200',
 'listing': 'auction',
 'location': 'Birmingham',
 'longitude': None,
 'make': 'CITROEN',
 'model': 'GRAND C4 PICASSO',
 'odometer': 89639,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214784,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2216200-4162592-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203307,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203307,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227084,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126600,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159287,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172185,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141752,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158603,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ceec2221-2c83-5cbb-a698-d3b774ebd58d/ceec2221-2c83-5cbb-a698-d3b774ebd58d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171889,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/98dbde28-2c82-4a12-9454-513f6f9e64be_9.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-10-21',
 'seller_name': None,
 'title': 'CITROEN GRAND C4 PICASSO 1.6 e-HDi 115 Airdream Exclusive+ 5dr ETG6',
 'transmission': 'automatic',
 'trim': '1.6 e-HDi 115 Airdream Exclusive+ 5dr ETG6',
 'year': 2014}
2026-04-22 13:12:56 [manheim.gb] INFO: Saving data for 2216200: {'created_time': 1776863576.563365, 'last_price_update_time': 1776863576.563377}
2026-04-22 13:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_5.jpg> (referer: None)
2026-04-22 13:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_5.jpg not downloaded yet
2026-04-22 13:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05136d0>
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_1.jpg saved to cache
2026-04-22 13:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7732648-c58d-5722-ba4b-19ade4918c0d
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03aa910>
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_9.jpg saved to cache
2026-04-22 13:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0a9bd099-3612-539e-a638-280f22191e67
2026-04-22 13:12:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c873a4c6-93d8-5dc1-af34-261b37411c16 with identifier: 2299977
2026-04-22 13:12:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c873a4c6-93d8-5dc1-af34-261b37411c16 with scrape type 1
2026-04-22 13:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item c873a4c6-93d8-5dc1-af34-261b37411c16
2026-04-22 13:12:56 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item c873a4c6-93d8-5dc1-af34-261b37411c16
2026-04-22 13:12:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c873a4c6-93d8-5dc1-af34-261b37411c16, identifier: 2299977
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05cfc10>
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_2.jpg saved to cache
2026-04-22 13:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a9bd099-3612-539e-a638-280f22191e67
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b057bb90>
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_6.jpg saved to cache
2026-04-22 13:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7732648-c58d-5722-ba4b-19ade4918c0d
2026-04-22 13:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_4.jpg> (referer: None)
2026-04-22 13:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_10.jpg> (referer: None)
2026-04-22 13:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_7.jpg> (referer: None)
2026-04-22 13:12:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c873a4c6-93d8-5dc1-af34-261b37411c16 with identifier: 2299977
2026-04-22 13:12:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c873a4c6-93d8-5dc1-af34-261b37411c16 with identifier: 2299977
2026-04-22 13:12:57 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: c873a4c6-93d8-5dc1-af34-261b37411c16 with identifier: 2299977 to the API
2026-04-22 13:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:57 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id c873a4c6-93d8-5dc1-af34-261b37411c16: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:56 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:57 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:57 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'c873a4c6-93d8-5dc1-af34-261b37411c16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KE14XLZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=2299977',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-08-20',
 'seller_name': None,
 'title': 'MERCEDES-BENZ A CLASS A200 [2.1] CDI AMG Sport 5dr',
 'transmission': 'manual',
 'trim': 'A200 [2.1] CDI AMG Sport 5dr',
 'year': 2014}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:57 [manheim.gb] INFO: Saving data for 2299977: {'created_time': 1776863577.230112, 'last_price_update_time': 1776863577.230121}
2026-04-22 13:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_10.jpg> (referer: None)
2026-04-22 13:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05d0cd0>
2026-04-22 13:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_7.jpg saved to cache
2026-04-22 13:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7732648-c58d-5722-ba4b-19ade4918c0d
2026-04-22 13:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32b5c486-c07e-53b3-beea-797032637262 with identifier: 2283768
2026-04-22 13:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32b5c486-c07e-53b3-beea-797032637262 with scrape type 1
2026-04-22 13:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 32b5c486-c07e-53b3-beea-797032637262
2026-04-22 13:12:57 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 32b5c486-c07e-53b3-beea-797032637262
2026-04-22 13:12:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 32b5c486-c07e-53b3-beea-797032637262, identifier: 2283768
2026-04-22 13:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_4.jpg> (referer: None)
2026-04-22 13:12:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 32b5c486-c07e-53b3-beea-797032637262 with identifier: 2283768
2026-04-22 13:12:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 32b5c486-c07e-53b3-beea-797032637262 with identifier: 2283768
2026-04-22 13:12:57 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 32b5c486-c07e-53b3-beea-797032637262 with identifier: 2283768 to the API
2026-04-22 13:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '32b5c486-c07e-53b3-beea-797032637262',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KP69BZS',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=2283768',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 37179,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-09-24',
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi GT Line 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi GT Line 5dr EAT8',
 'year': 2019}
2026-04-22 13:12:57 [manheim.gb] INFO: Saving data for 2283768: {'created_time': 1776863577.733244, 'last_price_update_time': 1776863577.733255}
2026-04-22 13:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_10.jpg> (referer: None)
2026-04-22 13:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04cda50>
2026-04-22 13:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_5.jpg saved to cache
2026-04-22 13:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7732648-c58d-5722-ba4b-19ade4918c0d
2026-04-22 13:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 897dc76d-5f28-5938-a640-6017c80082b0 with identifier: 2318533
2026-04-22 13:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 897dc76d-5f28-5938-a640-6017c80082b0 with scrape type 1
2026-04-22 13:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 897dc76d-5f28-5938-a640-6017c80082b0
2026-04-22 13:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2318533-4169787-13.jpg not downloaded yet
2026-04-22 13:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66d0ad67-e093-5097-94da-a6f859420731 with identifier: 2347452
2026-04-22 13:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d0ad67-e093-5097-94da-a6f859420731 with scrape type 1
2026-04-22 13:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 66d0ad67-e093-5097-94da-a6f859420731
2026-04-22 13:12:57 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 66d0ad67-e093-5097-94da-a6f859420731
2026-04-22 13:12:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 66d0ad67-e093-5097-94da-a6f859420731, identifier: 2347452
2026-04-22 13:12:57 [manheim.gb] INFO: Page 4: 100 results (total: 14785)
2026-04-22 13:12:57 [manheim.gb] INFO: Found listing with ID: 2356524
2026-04-22 13:12:57 [manheim.gb] INFO: Scrape type for 2356524: 1
2026-04-22 13:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40cd08fc-f793-588e-aa91-ffd678939183 with identifier: 2356132
2026-04-22 13:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40cd08fc-f793-588e-aa91-ffd678939183 with scrape type 1
2026-04-22 13:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 40cd08fc-f793-588e-aa91-ffd678939183
2026-04-22 13:12:57 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 40cd08fc-f793-588e-aa91-ffd678939183
2026-04-22 13:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 40cd08fc-f793-588e-aa91-ffd678939183, identifier: 2356132
2026-04-22 13:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b17759d0>
2026-04-22 13:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_4.jpg saved to cache
2026-04-22 13:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7732648-c58d-5722-ba4b-19ade4918c0d
2026-04-22 13:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1677a50>
2026-04-22 13:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_10.jpg saved to cache
2026-04-22 13:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a9bd099-3612-539e-a638-280f22191e67
2026-04-22 13:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05c4ad0>
2026-04-22 13:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_7.jpg saved to cache
2026-04-22 13:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a9bd099-3612-539e-a638-280f22191e67
2026-04-22 13:12:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a9bd099-3612-539e-a638-280f22191e67, skipping ID generation
2026-04-22 13:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a9bd099-3612-539e-a638-280f22191e67 with scrape type 1
2026-04-22 13:12:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a9bd099-3612-539e-a638-280f22191e67 sending to next pipeline
2026-04-22 13:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0a9bd099-3612-539e-a638-280f22191e67, identifier: 2251610
2026-04-22 13:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_9.jpg> (referer: None)
2026-04-22 13:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 66d0ad67-e093-5097-94da-a6f859420731 with identifier: 2347452
2026-04-22 13:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 66d0ad67-e093-5097-94da-a6f859420731 with identifier: 2347452
2026-04-22 13:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 66d0ad67-e093-5097-94da-a6f859420731 with identifier: 2347452 to the API
2026-04-22 13:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:12:58 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 66d0ad67-e093-5097-94da-a6f859420731: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:58 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:12:58 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:58 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '66d0ad67-e093-5097-94da-a6f859420731',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YF65NBD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=2347452',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO 1.0 110 SEL 3dr',
 'transmission': 'manual',
 'trim': '1.0 110 SEL 3dr',
 'year': 2015}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:12:58 [manheim.gb] INFO: Saving data for 2347452: {'created_time': 1776863578.630628, 'last_price_update_time': 1776863578.630641}
2026-04-22 13:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 40cd08fc-f793-588e-aa91-ffd678939183 with identifier: 2356132
2026-04-22 13:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 40cd08fc-f793-588e-aa91-ffd678939183 with identifier: 2356132
2026-04-22 13:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 40cd08fc-f793-588e-aa91-ffd678939183 with identifier: 2356132 to the API
2026-04-22 13:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '40cd08fc-f793-588e-aa91-ffd678939183',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'CE16AJV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=2356132',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'ALFA ROMEO',
 'model': 'GIULIETTA',
 'odometer': 47638,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-03-28',
 'seller_name': None,
 'title': 'ALFA ROMEO GIULIETTA 1.6 JTDM-2 120 Exclusive 5dr',
 'transmission': 'manual',
 'trim': '1.6 JTDM-2 120 Exclusive 5dr',
 'year': 2016}
2026-04-22 13:12:58 [manheim.gb] INFO: Saving data for 2356132: {'created_time': 1776863578.969682, 'last_price_update_time': 1776863578.969694}
2026-04-22 13:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0a9bd099-3612-539e-a638-280f22191e67 with identifier: 2251610
2026-04-22 13:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:12:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol+PHEV HTTP/1.1" 200 None
2026-04-22 13:12:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0a9bd099-3612-539e-a638-280f22191e67 with identifier: 2251610
2026-04-22 13:12:59 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0a9bd099-3612-539e-a638-280f22191e67 with identifier: 2251610 to the API
2026-04-22 13:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:12:59 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol PHEV',
 'id': '0a9bd099-3612-539e-a638-280f22191e67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'RX68GXG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLVO/V90?id=2251610',
 'listing': 'auction',
 'location': 'Manchester',
 'longitude': None,
 'make': 'VOLVO',
 'model': 'V90',
 'odometer': 64963,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196006,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196006,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281596,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170458,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215154,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199106,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212924,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187843,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186724,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a9bd099-3612-539e-a638-280f22191e67/0a9bd099-3612-539e-a638-280f22191e67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328930,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fae33531-1690-4ea5-a7fa-1aedaec16c6a_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-09-14',
 'seller_name': None,
 'title': 'VOLVO V90 2.0 T8 [390] Hybrid Inscription Pro 5dr AWD Gtron',
 'transmission': 'automatic',
 'trim': '2.0 T8 [390] Hybrid Inscription Pro 5dr AWD Gtron',
 'year': 2018}
2026-04-22 13:12:59 [manheim.gb] INFO: Saving data for 2251610: {'created_time': 1776863579.491576, 'last_price_update_time': 1776863579.491585}
2026-04-22 13:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05eb450>
2026-04-22 13:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:12:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:12:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_10.jpg saved to cache
2026-04-22 13:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ebf72445-9eec-5f52-8f82-a3ec3cad868f
2026-04-22 13:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88ac3e68-1a21-5937-9086-007ad3f5878c with identifier: 2271456
2026-04-22 13:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88ac3e68-1a21-5937-9086-007ad3f5878c with scrape type 1
2026-04-22 13:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 88ac3e68-1a21-5937-9086-007ad3f5878c
2026-04-22 13:12:59 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 88ac3e68-1a21-5937-9086-007ad3f5878c
2026-04-22 13:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 88ac3e68-1a21-5937-9086-007ad3f5878c, identifier: 2271456
2026-04-22 13:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b785ae77-0e6e-5ec8-81a8-db4b919313bd with identifier: 2264606
2026-04-22 13:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b785ae77-0e6e-5ec8-81a8-db4b919313bd with scrape type 1
2026-04-22 13:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b785ae77-0e6e-5ec8-81a8-db4b919313bd
2026-04-22 13:12:59 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b785ae77-0e6e-5ec8-81a8-db4b919313bd
2026-04-22 13:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b785ae77-0e6e-5ec8-81a8-db4b919313bd, identifier: 2264606
2026-04-22 13:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2293902-4167543-13.jpg> (referer: None)
2026-04-22 13:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_7.jpg not downloaded yet
2026-04-22 13:12:59 [manheim.gb] INFO: Found listing with ID: 2356925
2026-04-22 13:12:59 [manheim.gb] INFO: Scrape type for 2356925: 1
2026-04-22 13:12:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 88ac3e68-1a21-5937-9086-007ad3f5878c with identifier: 2271456
2026-04-22 13:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 88ac3e68-1a21-5937-9086-007ad3f5878c with identifier: 2271456
2026-04-22 13:12:59 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 88ac3e68-1a21-5937-9086-007ad3f5878c with identifier: 2271456 to the API
2026-04-22 13:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:12:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester - In Transit',
 'color': 'White',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '88ac3e68-1a21-5937-9086-007ad3f5878c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'NV17AVM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=2271456',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'longitude': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 43300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-06-14',
 'seller_name': None,
 'title': 'AUDI A3 1.0 TFSI SE 5dr',
 'transmission': 'manual',
 'trim': '1.0 TFSI SE 5dr',
 'year': 2017}
2026-04-22 13:13:00 [manheim.gb] INFO: Saving data for 2271456: {'created_time': 1776863580.112811, 'last_price_update_time': 1776863580.112828}
2026-04-22 13:13:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b785ae77-0e6e-5ec8-81a8-db4b919313bd with identifier: 2264606
2026-04-22 13:13:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b785ae77-0e6e-5ec8-81a8-db4b919313bd with identifier: 2264606
2026-04-22 13:13:00 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b785ae77-0e6e-5ec8-81a8-db4b919313bd with identifier: 2264606 to the API
2026-04-22 13:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:00 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id b785ae77-0e6e-5ec8-81a8-db4b919313bd: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:12:59 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:00 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:00 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington - In Transit',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'b785ae77-0e6e-5ec8-81a8-db4b919313bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'EH13OOD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/MICRA?id=2264606',
 'listing': 'auction',
 'location': 'Washington - In Transit',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-05-03',
 'seller_name': None,
 'title': 'NISSAN MICRA 1.2 DiG-S Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-S Tekna 5dr',
 'year': 2013}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:00 [manheim.gb] INFO: Saving data for 2264606: {'created_time': 1776863580.421874, 'last_price_update_time': 1776863580.421885}
2026-04-22 13:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_3.jpg> (referer: None)
2026-04-22 13:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_11.jpg> (referer: None)
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b071bb90>
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_4.jpg saved to cache
2026-04-22 13:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7732648-c58d-5722-ba4b-19ade4918c0d
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b061c810>
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_10.jpg saved to cache
2026-04-22 13:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 816346d6-1bb1-5844-a1c1-a3065f67bd35
2026-04-22 13:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_5.jpg> (referer: None)
2026-04-22 13:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_5.jpg> (referer: None)
2026-04-22 13:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_7.jpg not downloaded yet
2026-04-22 13:13:00 [manheim.gb] INFO: Found listing with ID: 2358415
2026-04-22 13:13:00 [manheim.gb] INFO: Scrape type for 2358415: 0
2026-04-22 13:13:00 [manheim.gb] INFO: Found listing with ID: 2368451
2026-04-22 13:13:00 [manheim.gb] INFO: Scrape type for 2368451: 1
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fbeb10>
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_9.jpg saved to cache
2026-04-22 13:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b548631d-4075-5a29-be0d-4d70179f04e2
2026-04-22 13:13:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b548631d-4075-5a29-be0d-4d70179f04e2, skipping ID generation
2026-04-22 13:13:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b548631d-4075-5a29-be0d-4d70179f04e2 with scrape type 1
2026-04-22 13:13:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b548631d-4075-5a29-be0d-4d70179f04e2 sending to next pipeline
2026-04-22 13:13:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b548631d-4075-5a29-be0d-4d70179f04e2, identifier: 2190852
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0708a10>
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2293902-4167543-13.jpg saved to cache
2026-04-22 13:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7732648-c58d-5722-ba4b-19ade4918c0d
2026-04-22 13:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_6.jpg not downloaded yet
2026-04-22 13:13:00 [manheim.gb] INFO: Found listing with ID: 2369546
2026-04-22 13:13:00 [manheim.gb] INFO: Scrape type for 2369546: 1
2026-04-22 13:13:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b548631d-4075-5a29-be0d-4d70179f04e2 with identifier: 2190852
2026-04-22 13:13:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b548631d-4075-5a29-be0d-4d70179f04e2 with identifier: 2190852
2026-04-22 13:13:00 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b548631d-4075-5a29-be0d-4d70179f04e2 with identifier: 2190852 to the API
2026-04-22 13:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:01 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'Red',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'b548631d-4075-5a29-be0d-4d70179f04e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'MM17YHR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=2190852',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 44181,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347957,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2190852-4162978-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214656,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214656,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253063,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196253,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222069,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214766,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215131,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216144,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b548631d-4075-5a29-be0d-4d70179f04e2/b548631d-4075-5a29-be0d-4d70179f04e2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215465,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d249a9f8-707c-4d3e-bf6d-4d2e74ba7589_9.jpg',
             'Width': 1500}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-06-30',
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PureTech Active 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Active 5dr',
 'year': 2017}
2026-04-22 13:13:01 [manheim.gb] INFO: Saving data for 2190852: {'created_time': 1776863581.227139, 'last_price_update_time': 1776863581.22715}
2026-04-22 13:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b101db10>
2026-04-22 13:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_3.jpg saved to cache
2026-04-22 13:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7732648-c58d-5722-ba4b-19ade4918c0d
2026-04-22 13:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1078250>
2026-04-22 13:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_11.jpg saved to cache
2026-04-22 13:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 816346d6-1bb1-5844-a1c1-a3065f67bd35
2026-04-22 13:13:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 816346d6-1bb1-5844-a1c1-a3065f67bd35, skipping ID generation
2026-04-22 13:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 816346d6-1bb1-5844-a1c1-a3065f67bd35 with scrape type 1
2026-04-22 13:13:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 816346d6-1bb1-5844-a1c1-a3065f67bd35 sending to next pipeline
2026-04-22 13:13:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 816346d6-1bb1-5844-a1c1-a3065f67bd35, identifier: 2161873
2026-04-22 13:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 816346d6-1bb1-5844-a1c1-a3065f67bd35 with identifier: 2161873
2026-04-22 13:13:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 816346d6-1bb1-5844-a1c1-a3065f67bd35 with identifier: 2161873
2026-04-22 13:13:01 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 816346d6-1bb1-5844-a1c1-a3065f67bd35 with identifier: 2161873 to the API
2026-04-22 13:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:01 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_11.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham',
 'color': 'Grey',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '816346d6-1bb1-5844-a1c1-a3065f67bd35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BT17BGE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ABARTH/595?id=2161873',
 'listing': 'auction',
 'location': 'Birmingham',
 'longitude': None,
 'make': 'ABARTH',
 'model': '595',
 'odometer': 57788,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158217,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2161873-4166970-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198886,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198886,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214754,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191203,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190256,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193661,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186820,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193045,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_816346d6-1bb1-5844-a1c1-a3065f67bd35/816346d6-1bb1-5844-a1c1-a3065f67bd35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198647,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3b3218d3-f3cb-4565-9ed0-10824febc86a_9.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-31',
 'seller_name': None,
 'title': 'ABARTH 595 1.4 T-Jet 160 Trofeo 3dr',
 'transmission': 'manual',
 'trim': '1.4 T-Jet 160 Trofeo 3dr',
 'year': 2017}
2026-04-22 13:13:01 [manheim.gb] INFO: Saving data for 2161873: {'created_time': 1776863581.896185, 'last_price_update_time': 1776863581.896195}
2026-04-22 13:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_1.jpg not downloaded yet
2026-04-22 13:13:01 [manheim.gb] INFO: Found listing with ID: 2373320
2026-04-22 13:13:01 [manheim.gb] INFO: Scrape type for 2373320: 1
2026-04-22 13:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b162ba50>
2026-04-22 13:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_5.jpg saved to cache
2026-04-22 13:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebf72445-9eec-5f52-8f82-a3ec3cad868f
2026-04-22 13:13:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebf72445-9eec-5f52-8f82-a3ec3cad868f, skipping ID generation
2026-04-22 13:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebf72445-9eec-5f52-8f82-a3ec3cad868f with scrape type 1
2026-04-22 13:13:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebf72445-9eec-5f52-8f82-a3ec3cad868f sending to next pipeline
2026-04-22 13:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ebf72445-9eec-5f52-8f82-a3ec3cad868f, identifier: 219242
2026-04-22 13:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0561f90>
2026-04-22 13:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_5.jpg saved to cache
2026-04-22 13:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7732648-c58d-5722-ba4b-19ade4918c0d
2026-04-22 13:13:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7732648-c58d-5722-ba4b-19ade4918c0d, skipping ID generation
2026-04-22 13:13:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7732648-c58d-5722-ba4b-19ade4918c0d with scrape type 1
2026-04-22 13:13:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7732648-c58d-5722-ba4b-19ade4918c0d sending to next pipeline
2026-04-22 13:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e7732648-c58d-5722-ba4b-19ade4918c0d, identifier: 2293902
2026-04-22 13:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_7.jpg> (referer: None)
2026-04-22 13:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_5.jpg not downloaded yet
2026-04-22 13:13:02 [manheim.gb] INFO: Found listing with ID: 2373472
2026-04-22 13:13:02 [manheim.gb] INFO: Scrape type for 2373472: 0
2026-04-22 13:13:02 [manheim.gb] INFO: Found listing with ID: 2375428
2026-04-22 13:13:02 [manheim.gb] INFO: Scrape type for 2375428: 1
2026-04-22 13:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ebf72445-9eec-5f52-8f82-a3ec3cad868f with identifier: 219242
2026-04-22 13:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ebf72445-9eec-5f52-8f82-a3ec3cad868f with identifier: 219242
2026-04-22 13:13:02 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ebf72445-9eec-5f52-8f82-a3ec3cad868f with identifier: 219242 to the API
2026-04-22 13:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:02 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'ebf72445-9eec-5f52-8f82-a3ec3cad868f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'RV62NTG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SMART/FORTWO%20COUPE?id=219242',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'SMART',
 'model': 'FORTWO COUPE',
 'odometer': 65617,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246255,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246255,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338288,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171553,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215378,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210143,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224736,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208094,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202813,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf72445-9eec-5f52-8f82-a3ec3cad868f/ebf72445-9eec-5f52-8f82-a3ec3cad868f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289878,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1a7dc44a-ed60-44c5-b9af-3a9f74aef527_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2012-10-13',
 'seller_name': None,
 'title': 'SMART FORTWO COUPE Passion mhd 2dr Softouch Auto [2010]',
 'transmission': 'automatic',
 'trim': 'Passion mhd 2dr Softouch Auto [2010]',
 'year': 2012}
2026-04-22 13:13:02 [manheim.gb] INFO: Saving data for 219242: {'created_time': 1776863582.680504, 'last_price_update_time': 1776863582.680515}
2026-04-22 13:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e7732648-c58d-5722-ba4b-19ade4918c0d with identifier: 2293902
2026-04-22 13:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e7732648-c58d-5722-ba4b-19ade4918c0d with identifier: 2293902
2026-04-22 13:13:02 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e7732648-c58d-5722-ba4b-19ade4918c0d with identifier: 2293902 to the API
2026-04-22 13:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'e7732648-c58d-5722-ba4b-19ade4918c0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'GD67YON',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLVO/S60?id=2293902',
 'listing': 'auction',
 'location': 'Manchester',
 'longitude': None,
 'make': 'VOLVO',
 'model': 'S60',
 'odometer': 70845,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194325,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194325,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237612,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170821,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207332,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191524,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 444630,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2293902-4167543-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224921,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207018,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7732648-c58d-5722-ba4b-19ade4918c0d/e7732648-c58d-5722-ba4b-19ade4918c0d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219925,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3c166dcb-92a3-41a9-8ed9-247678864d8b_ext_5.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-02-07',
 'seller_name': None,
 'title': 'VOLVO S60 T4 [190] SE Nav 4dr Geartronic [Leather]',
 'transmission': 'automatic',
 'trim': 'T4 [190] SE Nav 4dr Geartronic [Leather]',
 'year': 2018}
2026-04-22 13:13:03 [manheim.gb] INFO: Saving data for 2293902: {'created_time': 1776863583.036109, 'last_price_update_time': 1776863583.036121}
2026-04-22 13:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2318533-4169787-13.jpg> (referer: None)
2026-04-22 13:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87ebcc2c-5616-56d5-b8ed-7c78bb4eac85 with identifier: 2356524
2026-04-22 13:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87ebcc2c-5616-56d5-b8ed-7c78bb4eac85 with scrape type 1
2026-04-22 13:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 87ebcc2c-5616-56d5-b8ed-7c78bb4eac85
2026-04-22 13:13:03 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 87ebcc2c-5616-56d5-b8ed-7c78bb4eac85
2026-04-22 13:13:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 87ebcc2c-5616-56d5-b8ed-7c78bb4eac85, identifier: 2356524
2026-04-22 13:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_7.jpg> (referer: None)
2026-04-22 13:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_4.jpg not downloaded yet
2026-04-22 13:13:03 [manheim.gb] INFO: Found listing with ID: 2376705
2026-04-22 13:13:03 [manheim.gb] INFO: Scrape type for 2376705: 0
2026-04-22 13:13:03 [manheim.gb] INFO: Found listing with ID: 2383057
2026-04-22 13:13:03 [manheim.gb] INFO: Scrape type for 2383057: 1
2026-04-22 13:13:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 87ebcc2c-5616-56d5-b8ed-7c78bb4eac85 with identifier: 2356524
2026-04-22 13:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:13:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diamond+Black+with+Ivory+Roof HTTP/1.1" 200 None
2026-04-22 13:13:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:13:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 87ebcc2c-5616-56d5-b8ed-7c78bb4eac85 with identifier: 2356524
2026-04-22 13:13:03 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 87ebcc2c-5616-56d5-b8ed-7c78bb4eac85 with identifier: 2356524 to the API
2026-04-22 13:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:03 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 87ebcc2c-5616-56d5-b8ed-7c78bb4eac85: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:03 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:03 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:03 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'Diamond Black with Ivory Roof',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '87ebcc2c-5616-56d5-b8ed-7c78bb4eac85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'HL19AJX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=2356524',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-06-14',
 'seller_name': None,
 'title': 'RENAULT CAPTUR 1.5 dCi 90 Iconic 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi 90 Iconic 5dr',
 'year': 2019}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:03 [manheim.gb] INFO: Saving data for 2356524: {'created_time': 1776863583.665409, 'last_price_update_time': 1776863583.66542}
2026-04-22 13:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e01bd410-452d-510f-bd82-bef7fe04beeb with identifier: 2356925
2026-04-22 13:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e01bd410-452d-510f-bd82-bef7fe04beeb with scrape type 1
2026-04-22 13:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e01bd410-452d-510f-bd82-bef7fe04beeb
2026-04-22 13:13:03 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e01bd410-452d-510f-bd82-bef7fe04beeb
2026-04-22 13:13:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e01bd410-452d-510f-bd82-bef7fe04beeb, identifier: 2356925
2026-04-22 13:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03cf910>
2026-04-22 13:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_7.jpg saved to cache
2026-04-22 13:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 897dc76d-5f28-5938-a640-6017c80082b0
2026-04-22 13:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_11.jpg not downloaded yet
2026-04-22 13:13:03 [manheim.gb] INFO: Found listing with ID: 2390920
2026-04-22 13:13:03 [manheim.gb] INFO: Scrape type for 2390920: 1
2026-04-22 13:13:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e01bd410-452d-510f-bd82-bef7fe04beeb with identifier: 2356925
2026-04-22 13:13:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e01bd410-452d-510f-bd82-bef7fe04beeb with identifier: 2356925
2026-04-22 13:13:03 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e01bd410-452d-510f-bd82-bef7fe04beeb with identifier: 2356925 to the API
2026-04-22 13:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'e01bd410-452d-510f-bd82-bef7fe04beeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YE63JJV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2356925',
 'listing': 'auction',
 'location': 'Washington',
 'longitude': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 83305,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-11-11',
 'seller_name': None,
 'title': 'FORD FIESTA 1.5 TDCi Zetec 3dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi Zetec 3dr',
 'year': 2013}
2026-04-22 13:13:04 [manheim.gb] INFO: Saving data for 2356925: {'created_time': 1776863584.209897, 'last_price_update_time': 1776863584.209909}
2026-04-22 13:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1079fd0>
2026-04-22 13:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2318533-4169787-13.jpg saved to cache
2026-04-22 13:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 897dc76d-5f28-5938-a640-6017c80082b0
2026-04-22 13:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 069dbb72-9550-5c18-afc4-812b6e00db02 with identifier: 2368451
2026-04-22 13:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 069dbb72-9550-5c18-afc4-812b6e00db02 with scrape type 1
2026-04-22 13:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 069dbb72-9550-5c18-afc4-812b6e00db02
2026-04-22 13:13:04 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 069dbb72-9550-5c18-afc4-812b6e00db02
2026-04-22 13:13:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 069dbb72-9550-5c18-afc4-812b6e00db02, identifier: 2368451
2026-04-22 13:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03cdad0>
2026-04-22 13:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_7.jpg saved to cache
2026-04-22 13:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 897dc76d-5f28-5938-a640-6017c80082b0
2026-04-22 13:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_6.jpg> (referer: None)
2026-04-22 13:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_1.jpg> (referer: None)
2026-04-22 13:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_10.jpg not downloaded yet
2026-04-22 13:13:04 [manheim.gb] INFO: Found listing with ID: 2392039
2026-04-22 13:13:04 [manheim.gb] INFO: Scrape type for 2392039: 2
2026-04-22 13:13:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 069dbb72-9550-5c18-afc4-812b6e00db02 with identifier: 2368451
2026-04-22 13:13:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 069dbb72-9550-5c18-afc4-812b6e00db02 with identifier: 2368451
2026-04-22 13:13:04 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 069dbb72-9550-5c18-afc4-812b6e00db02 with identifier: 2368451 to the API
2026-04-22 13:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '069dbb72-9550-5c18-afc4-812b6e00db02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'GX63UAE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/SCIROCCO?id=2368451',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'SCIROCCO',
 'odometer': 107071,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-09-02',
 'seller_name': None,
 'title': 'VOLKSWAGEN SCIROCCO 2.0 TDi BlueMotion Tech 3dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDi BlueMotion Tech 3dr DSG',
 'year': 2013}
2026-04-22 13:13:04 [manheim.gb] INFO: Saving data for 2368451: {'created_time': 1776863584.798245, 'last_price_update_time': 1776863584.798255}
2026-04-22 13:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e10fd4e-5a52-5430-af54-ae97e3870407 with identifier: 2369546
2026-04-22 13:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e10fd4e-5a52-5430-af54-ae97e3870407 with scrape type 1
2026-04-22 13:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7e10fd4e-5a52-5430-af54-ae97e3870407
2026-04-22 13:13:04 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7e10fd4e-5a52-5430-af54-ae97e3870407
2026-04-22 13:13:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 7e10fd4e-5a52-5430-af54-ae97e3870407, identifier: 2369546
2026-04-22 13:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 7e10fd4e-5a52-5430-af54-ae97e3870407 with identifier: 2369546
2026-04-22 13:13:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 7e10fd4e-5a52-5430-af54-ae97e3870407 with identifier: 2369546
2026-04-22 13:13:05 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 7e10fd4e-5a52-5430-af54-ae97e3870407 with identifier: 2369546 to the API
2026-04-22 13:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester - In Transit',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '7e10fd4e-5a52-5430-af54-ae97e3870407',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'GX17UHN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PORSCHE/MACAN?id=2369546',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'longitude': None,
 'make': 'PORSCHE',
 'model': 'MACAN',
 'odometer': 88464,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-04-13',
 'seller_name': None,
 'title': 'PORSCHE MACAN S Diesel 5dr PDK',
 'transmission': 'automatic',
 'trim': 'S Diesel 5dr PDK',
 'year': 2017}
2026-04-22 13:13:05 [manheim.gb] INFO: Saving data for 2369546: {'created_time': 1776863585.247374, 'last_price_update_time': 1776863585.247385}
2026-04-22 13:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 914c4eff-5642-5fce-a19b-f743049f05ff with identifier: 2373320
2026-04-22 13:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 914c4eff-5642-5fce-a19b-f743049f05ff with scrape type 1
2026-04-22 13:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 914c4eff-5642-5fce-a19b-f743049f05ff
2026-04-22 13:13:05 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 914c4eff-5642-5fce-a19b-f743049f05ff
2026-04-22 13:13:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 914c4eff-5642-5fce-a19b-f743049f05ff, identifier: 2373320
2026-04-22 13:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_9.jpg not downloaded yet
2026-04-22 13:13:05 [manheim.gb] INFO: Found listing with ID: 2394263
2026-04-22 13:13:05 [manheim.gb] INFO: Scrape type for 2394263: 1
2026-04-22 13:13:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 914c4eff-5642-5fce-a19b-f743049f05ff with identifier: 2373320
2026-04-22 13:13:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 914c4eff-5642-5fce-a19b-f743049f05ff with identifier: 2373320
2026-04-22 13:13:05 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 914c4eff-5642-5fce-a19b-f743049f05ff with identifier: 2373320 to the API
2026-04-22 13:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:05 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 914c4eff-5642-5fce-a19b-f743049f05ff: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:05 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:05 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:05 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'BEIGE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '914c4eff-5642-5fce-a19b-f743049f05ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KJ19YBM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3%20AIRCROSS?id=2373320',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'CITROEN',
 'model': 'C3 AIRCROSS',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-05-29',
 'seller_name': None,
 'title': 'CITROEN C3 AIRCROSS 1.2 PureTech Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Flair 5dr',
 'year': 2019}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:05 [manheim.gb] INFO: Saving data for 2373320: {'created_time': 1776863585.68031, 'last_price_update_time': 1776863585.680322}
2026-04-22 13:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_5.jpg> (referer: None)
2026-04-22 13:13:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0582790>
2026-04-22 13:13:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_6.jpg saved to cache
2026-04-22 13:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 897dc76d-5f28-5938-a640-6017c80082b0
2026-04-22 13:13:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2b1efd0>
2026-04-22 13:13:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_1.jpg saved to cache
2026-04-22 13:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 897dc76d-5f28-5938-a640-6017c80082b0
2026-04-22 13:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:05 [manheim.gb] INFO: Found listing with ID: 2403572
2026-04-22 13:13:05 [manheim.gb] INFO: Scrape type for 2403572: 1
2026-04-22 13:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_4.jpg> (referer: None)
2026-04-22 13:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bbc1646-d817-5d68-9870-d323a7b96860 with identifier: 2375428
2026-04-22 13:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bbc1646-d817-5d68-9870-d323a7b96860 with scrape type 1
2026-04-22 13:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6bbc1646-d817-5d68-9870-d323a7b96860
2026-04-22 13:13:05 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6bbc1646-d817-5d68-9870-d323a7b96860
2026-04-22 13:13:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6bbc1646-d817-5d68-9870-d323a7b96860, identifier: 2375428
2026-04-22 13:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1edc4cc1-5c4c-58d3-81a8-22bdadba05ac with identifier: 2383057
2026-04-22 13:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1edc4cc1-5c4c-58d3-81a8-22bdadba05ac with scrape type 1
2026-04-22 13:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 1edc4cc1-5c4c-58d3-81a8-22bdadba05ac
2026-04-22 13:13:05 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 1edc4cc1-5c4c-58d3-81a8-22bdadba05ac
2026-04-22 13:13:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1edc4cc1-5c4c-58d3-81a8-22bdadba05ac, identifier: 2383057
2026-04-22 13:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_11.jpg> (referer: None)
2026-04-22 13:13:06 [manheim.gb] INFO: Found listing with ID: 2405998
2026-04-22 13:13:06 [manheim.gb] INFO: Scrape type for 2405998: 0
2026-04-22 13:13:06 [manheim.gb] INFO: Found listing with ID: 2409563
2026-04-22 13:13:06 [manheim.gb] INFO: Scrape type for 2409563: 1
2026-04-22 13:13:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6bbc1646-d817-5d68-9870-d323a7b96860 with identifier: 2375428
2026-04-22 13:13:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6bbc1646-d817-5d68-9870-d323a7b96860 with identifier: 2375428
2026-04-22 13:13:06 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 6bbc1646-d817-5d68-9870-d323a7b96860 with identifier: 2375428 to the API
2026-04-22 13:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham',
 'color': 'Blue',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '6bbc1646-d817-5d68-9870-d323a7b96860',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'EY17GNZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C1?id=2375428',
 'listing': 'auction',
 'location': 'Birmingham',
 'longitude': None,
 'make': 'CITROEN',
 'model': 'C1',
 'odometer': 53441,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-31',
 'seller_name': None,
 'title': 'CITROEN C1 1.2 PureTech Feel 3dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Feel 3dr',
 'year': 2017}
2026-04-22 13:13:06 [manheim.gb] INFO: Saving data for 2375428: {'created_time': 1776863586.477163, 'last_price_update_time': 1776863586.477178}
2026-04-22 13:13:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1edc4cc1-5c4c-58d3-81a8-22bdadba05ac with identifier: 2383057
2026-04-22 13:13:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1edc4cc1-5c4c-58d3-81a8-22bdadba05ac with identifier: 2383057
2026-04-22 13:13:06 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 1edc4cc1-5c4c-58d3-81a8-22bdadba05ac with identifier: 2383057 to the API
2026-04-22 13:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '1edc4cc1-5c4c-58d3-81a8-22bdadba05ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KU64XCH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PORSCHE/MACAN?id=2383057',
 'listing': 'auction',
 'location': 'Washington',
 'longitude': None,
 'make': 'PORSCHE',
 'model': 'MACAN',
 'odometer': 97150,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2014-09-13',
 'seller_name': None,
 'title': 'PORSCHE MACAN S Diesel 5dr PDK',
 'transmission': 'automatic',
 'trim': 'S Diesel 5dr PDK',
 'year': 2014}
2026-04-22 13:13:06 [manheim.gb] INFO: Saving data for 2383057: {'created_time': 1776863586.931465, 'last_price_update_time': 1776863586.931477}
2026-04-22 13:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b19f46d0>
2026-04-22 13:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_5.jpg saved to cache
2026-04-22 13:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 897dc76d-5f28-5938-a640-6017c80082b0
2026-04-22 13:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:07 [manheim.gb] INFO: Found listing with ID: 2412062
2026-04-22 13:13:07 [manheim.gb] INFO: Scrape type for 2412062: 0
2026-04-22 13:13:07 [manheim.gb] INFO: Found listing with ID: 2419576
2026-04-22 13:13:07 [manheim.gb] INFO: Scrape type for 2419576: 1
2026-04-22 13:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e126f92a-ca95-526a-8e98-78066295643f with identifier: 2390920
2026-04-22 13:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e126f92a-ca95-526a-8e98-78066295643f with scrape type 1
2026-04-22 13:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e126f92a-ca95-526a-8e98-78066295643f
2026-04-22 13:13:07 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e126f92a-ca95-526a-8e98-78066295643f
2026-04-22 13:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e126f92a-ca95-526a-8e98-78066295643f, identifier: 2390920
2026-04-22 13:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1676090>
2026-04-22 13:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_4.jpg saved to cache
2026-04-22 13:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 897dc76d-5f28-5938-a640-6017c80082b0
2026-04-22 13:13:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e126f92a-ca95-526a-8e98-78066295643f with identifier: 2390920
2026-04-22 13:13:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e126f92a-ca95-526a-8e98-78066295643f with identifier: 2390920
2026-04-22 13:13:07 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e126f92a-ca95-526a-8e98-78066295643f with identifier: 2390920 to the API
2026-04-22 13:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:07 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id e126f92a-ca95-526a-8e98-78066295643f: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:07 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:07 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:07 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'e126f92a-ca95-526a-8e98-78066295643f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'FH18VPZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIA?id=2390920',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'ALFA ROMEO',
 'model': 'GIULIA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-07-06',
 'seller_name': None,
 'title': 'ALFA ROMEO GIULIA 2.0 TB 280 Veloce 4dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TB 280 Veloce 4dr Auto',
 'year': 2018}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:07 [manheim.gb] INFO: Saving data for 2390920: {'created_time': 1776863587.49618, 'last_price_update_time': 1776863587.49619}
2026-04-22 13:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b070b5d0>
2026-04-22 13:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_11.jpg saved to cache
2026-04-22 13:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 897dc76d-5f28-5938-a640-6017c80082b0
2026-04-22 13:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_10.jpg> (referer: None)
2026-04-22 13:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_9.jpg> (referer: None)
2026-04-22 13:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:07 [manheim.gb] INFO: Found listing with ID: 2422460
2026-04-22 13:13:07 [manheim.gb] INFO: Scrape type for 2422460: 0
2026-04-22 13:13:07 [manheim.gb] INFO: Found listing with ID: 2444546
2026-04-22 13:13:07 [manheim.gb] INFO: Scrape type for 2444546: 1
2026-04-22 13:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ebc7ab2-b445-5033-bf56-e4afae8e1dd9 with identifier: 2392039
2026-04-22 13:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ebc7ab2-b445-5033-bf56-e4afae8e1dd9 with scrape type 2
2026-04-22 13:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ebc7ab2-b445-5033-bf56-e4afae8e1dd9 with scrape type 2
2026-04-22 13:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2ebc7ab2-b445-5033-bf56-e4afae8e1dd9, identifier: 2392039
2026-04-22 13:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6e1e075-2125-5c1d-9f75-04fa41265fc5 with identifier: 2394263
2026-04-22 13:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6e1e075-2125-5c1d-9f75-04fa41265fc5 with scrape type 1
2026-04-22 13:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e6e1e075-2125-5c1d-9f75-04fa41265fc5
2026-04-22 13:13:07 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e6e1e075-2125-5c1d-9f75-04fa41265fc5
2026-04-22 13:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e6e1e075-2125-5c1d-9f75-04fa41265fc5, identifier: 2394263
2026-04-22 13:13:07 [manheim.gb] INFO: Found listing with ID: 2453882
2026-04-22 13:13:07 [manheim.gb] INFO: Scrape type for 2453882: 0
2026-04-22 13:13:07 [manheim.gb] INFO: Found listing with ID: 2460487
2026-04-22 13:13:07 [manheim.gb] INFO: Scrape type for 2460487: 0
2026-04-22 13:13:07 [manheim.gb] INFO: Found listing with ID: 2461022
2026-04-22 13:13:07 [manheim.gb] INFO: Scrape type for 2461022: 1
2026-04-22 13:13:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2ebc7ab2-b445-5033-bf56-e4afae8e1dd9 with identifier: 2392039
2026-04-22 13:13:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2ebc7ab2-b445-5033-bf56-e4afae8e1dd9 with identifier: 2392039
2026-04-22 13:13:08 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 2ebc7ab2-b445-5033-bf56-e4afae8e1dd9 with identifier: 2392039 to the API
2026-04-22 13:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '2ebc7ab2-b445-5033-bf56-e4afae8e1dd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DE12ZGA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/KA?id=2392039',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'FORD',
 'model': 'KA',
 'odometer': 90954,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2012-04-27',
 'seller_name': None,
 'title': 'FORD KA 1.2 Zetec 3dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.2 Zetec 3dr [Start Stop]',
 'year': 2012}
2026-04-22 13:13:08 [manheim.gb] INFO: Saving data for 2392039: {'created_time': 1776247798.727701, 'last_price_update_time': 1776863588.221583}
2026-04-22 13:13:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e6e1e075-2125-5c1d-9f75-04fa41265fc5 with identifier: 2394263
2026-04-22 13:13:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e6e1e075-2125-5c1d-9f75-04fa41265fc5 with identifier: 2394263
2026-04-22 13:13:08 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e6e1e075-2125-5c1d-9f75-04fa41265fc5 with identifier: 2394263 to the API
2026-04-22 13:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:08 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id e6e1e075-2125-5c1d-9f75-04fa41265fc5: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:08 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:08 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:08 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'GREEN',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'e6e1e075-2125-5c1d-9f75-04fa41265fc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'HF66KUB',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2394263',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-09-01',
 'seller_name': None,
 'title': 'FIAT 500 1.2 Lounge 3dr',
 'transmission': 'manual',
 'trim': '1.2 Lounge 3dr',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:08 [manheim.gb] INFO: Saving data for 2394263: {'created_time': 1776863588.538514, 'last_price_update_time': 1776863588.538525}
2026-04-22 13:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:08 [manheim.gb] INFO: Found listing with ID: 2463386
2026-04-22 13:13:08 [manheim.gb] INFO: Scrape type for 2463386: 2
2026-04-22 13:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b18817d0>
2026-04-22 13:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_10.jpg saved to cache
2026-04-22 13:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 897dc76d-5f28-5938-a640-6017c80082b0
2026-04-22 13:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2b1ff90>
2026-04-22 13:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_9.jpg saved to cache
2026-04-22 13:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 897dc76d-5f28-5938-a640-6017c80082b0
2026-04-22 13:13:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 897dc76d-5f28-5938-a640-6017c80082b0, skipping ID generation
2026-04-22 13:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 897dc76d-5f28-5938-a640-6017c80082b0 with scrape type 1
2026-04-22 13:13:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 897dc76d-5f28-5938-a640-6017c80082b0 sending to next pipeline
2026-04-22 13:13:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 897dc76d-5f28-5938-a640-6017c80082b0, identifier: 2318533
2026-04-22 13:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bea1320-f2ca-565b-bfdb-911efc35c341 with identifier: 2403572
2026-04-22 13:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bea1320-f2ca-565b-bfdb-911efc35c341 with scrape type 1
2026-04-22 13:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 4bea1320-f2ca-565b-bfdb-911efc35c341
2026-04-22 13:13:08 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 4bea1320-f2ca-565b-bfdb-911efc35c341
2026-04-22 13:13:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4bea1320-f2ca-565b-bfdb-911efc35c341, identifier: 2403572
2026-04-22 13:13:08 [manheim.gb] INFO: Found listing with ID: 2464383
2026-04-22 13:13:08 [manheim.gb] INFO: Scrape type for 2464383: 1
2026-04-22 13:13:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 897dc76d-5f28-5938-a640-6017c80082b0 with identifier: 2318533
2026-04-22 13:13:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 897dc76d-5f28-5938-a640-6017c80082b0 with identifier: 2318533
2026-04-22 13:13:09 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 897dc76d-5f28-5938-a640-6017c80082b0 with identifier: 2318533 to the API
2026-04-22 13:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:09 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '897dc76d-5f28-5938-a640-6017c80082b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'LK17RHZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/V%20CLASS?id=2318533',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'V CLASS',
 'odometer': 47958,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321317,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2318533-4169787-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224551,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224551,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296761,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141915,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221044,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214155,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224586,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210668,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_897dc76d-5f28-5938-a640-6017c80082b0/897dc76d-5f28-5938-a640-6017c80082b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220449,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/302ef0fb-895c-4a3a-a7aa-97f14f598a7b_9.jpg',
             'Width': 1500}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-31',
 'seller_name': None,
 'title': 'MERCEDES-BENZ V CLASS V250 d AMG Line 5dr Auto [Extra Long]',
 'transmission': 'automatic',
 'trim': 'V250 d AMG Line 5dr Auto [Extra Long]',
 'year': 2017}
2026-04-22 13:13:09 [manheim.gb] INFO: Saving data for 2318533: {'created_time': 1776863589.267946, 'last_price_update_time': 1776863589.267957}
2026-04-22 13:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4bea1320-f2ca-565b-bfdb-911efc35c341 with identifier: 2403572
2026-04-22 13:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4bea1320-f2ca-565b-bfdb-911efc35c341 with identifier: 2403572
2026-04-22 13:13:09 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 4bea1320-f2ca-565b-bfdb-911efc35c341 with identifier: 2403572 to the API
2026-04-22 13:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'GREEN',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '4bea1320-f2ca-565b-bfdb-911efc35c341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'FP67HFT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2403572',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 79670,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-11-02',
 'seller_name': None,
 'title': 'FORD FIESTA 1.5 TDCi 120 Titanium B+O Play 5dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi 120 Titanium B+O Play 5dr',
 'year': 2017}
2026-04-22 13:13:09 [manheim.gb] INFO: Saving data for 2403572: {'created_time': 1776863589.595446, 'last_price_update_time': 1776863589.595456}
2026-04-22 13:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:09 [manheim.gb] INFO: Found listing with ID: 2466891
2026-04-22 13:13:09 [manheim.gb] INFO: Scrape type for 2466891: 1
2026-04-22 13:13:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5638551-d571-5aba-9c4c-1e4586af9e10 with identifier: 2409563
2026-04-22 13:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5638551-d571-5aba-9c4c-1e4586af9e10 with scrape type 1
2026-04-22 13:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5638551-d571-5aba-9c4c-1e4586af9e10
2026-04-22 13:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_7.jpg not downloaded yet
2026-04-22 13:13:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 757f264c-6c20-5aaa-84a2-d9682846f364 with identifier: 2419576
2026-04-22 13:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 757f264c-6c20-5aaa-84a2-d9682846f364 with scrape type 1
2026-04-22 13:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 757f264c-6c20-5aaa-84a2-d9682846f364
2026-04-22 13:13:09 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 757f264c-6c20-5aaa-84a2-d9682846f364
2026-04-22 13:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 757f264c-6c20-5aaa-84a2-d9682846f364, identifier: 2419576
2026-04-22 13:13:09 [manheim.gb] INFO: Found listing with ID: 2467016
2026-04-22 13:13:09 [manheim.gb] INFO: Scrape type for 2467016: 0
2026-04-22 13:13:09 [manheim.gb] INFO: Found listing with ID: 2467989
2026-04-22 13:13:09 [manheim.gb] INFO: Scrape type for 2467989: 0
2026-04-22 13:13:09 [manheim.gb] INFO: Found listing with ID: 2469559
2026-04-22 13:13:09 [manheim.gb] INFO: Scrape type for 2469559: 1
2026-04-22 13:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 757f264c-6c20-5aaa-84a2-d9682846f364 with identifier: 2419576
2026-04-22 13:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 757f264c-6c20-5aaa-84a2-d9682846f364 with identifier: 2419576
2026-04-22 13:13:09 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 757f264c-6c20-5aaa-84a2-d9682846f364 with identifier: 2419576 to the API
2026-04-22 13:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:10 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 757f264c-6c20-5aaa-84a2-d9682846f364: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:09 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:10 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:10 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '757f264c-6c20-5aaa-84a2-d9682846f364',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'MD19EBM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=2419576',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-05-10',
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6T GDi ISG GT-Line 5dr DCT Auto [AWD]',
 'transmission': 'automatic',
 'trim': '1.6T GDi ISG GT-Line 5dr DCT Auto [AWD]',
 'year': 2019}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:10 [manheim.gb] INFO: Saving data for 2419576: {'created_time': 1776863590.102704, 'last_price_update_time': 1776863590.102717}
2026-04-22 13:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_7.jpg not downloaded yet
2026-04-22 13:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:10 [manheim.gb] INFO: Found listing with ID: 2472180
2026-04-22 13:13:10 [manheim.gb] INFO: Scrape type for 2472180: 1
2026-04-22 13:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_6.jpg not downloaded yet
2026-04-22 13:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f1086e-12df-5c91-9240-ff8424af08cf with identifier: 2444546
2026-04-22 13:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f1086e-12df-5c91-9240-ff8424af08cf with scrape type 1
2026-04-22 13:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item d5f1086e-12df-5c91-9240-ff8424af08cf
2026-04-22 13:13:10 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item d5f1086e-12df-5c91-9240-ff8424af08cf
2026-04-22 13:13:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d5f1086e-12df-5c91-9240-ff8424af08cf, identifier: 2444546
2026-04-22 13:13:10 [manheim.gb] INFO: Found listing with ID: 2475613
2026-04-22 13:13:10 [manheim.gb] INFO: Scrape type for 2475613: 1
2026-04-22 13:13:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d5f1086e-12df-5c91-9240-ff8424af08cf with identifier: 2444546
2026-04-22 13:13:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d5f1086e-12df-5c91-9240-ff8424af08cf with identifier: 2444546
2026-04-22 13:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: d5f1086e-12df-5c91-9240-ff8424af08cf with identifier: 2444546 to the API
2026-04-22 13:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:10 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id d5f1086e-12df-5c91-9240-ff8424af08cf: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:10 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:10 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:10 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '0.9L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'd5f1086e-12df-5c91-9240-ff8424af08cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WR18FKL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/MICRA?id=2444546',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-08-28',
 'seller_name': None,
 'title': 'NISSAN MICRA 0.9 IG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '0.9 IG-T N-Connecta 5dr',
 'year': 2018}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:10 [manheim.gb] INFO: Saving data for 2444546: {'created_time': 1776863590.67276, 'last_price_update_time': 1776863590.672773}
2026-04-22 13:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_1.jpg not downloaded yet
2026-04-22 13:13:10 [manheim.gb] INFO: Found listing with ID: 2482676
2026-04-22 13:13:10 [manheim.gb] INFO: Scrape type for 2482676: 1
2026-04-22 13:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_5.jpg not downloaded yet
2026-04-22 13:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 437a650d-3278-5405-84ca-d790beeb3253 with identifier: 2461022
2026-04-22 13:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 437a650d-3278-5405-84ca-d790beeb3253 with scrape type 1
2026-04-22 13:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 437a650d-3278-5405-84ca-d790beeb3253
2026-04-22 13:13:10 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 437a650d-3278-5405-84ca-d790beeb3253
2026-04-22 13:13:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 437a650d-3278-5405-84ca-d790beeb3253, identifier: 2461022
2026-04-22 13:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26ea92d6-e96c-5ccc-9b25-dde6d17219fb with identifier: 2463386
2026-04-22 13:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26ea92d6-e96c-5ccc-9b25-dde6d17219fb with scrape type 2
2026-04-22 13:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26ea92d6-e96c-5ccc-9b25-dde6d17219fb with scrape type 2
2026-04-22 13:13:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 26ea92d6-e96c-5ccc-9b25-dde6d17219fb, identifier: 2463386
2026-04-22 13:13:10 [manheim.gb] INFO: Found listing with ID: 2485842
2026-04-22 13:13:10 [manheim.gb] INFO: Scrape type for 2485842: 0
2026-04-22 13:13:10 [manheim.gb] INFO: Found listing with ID: 2486790
2026-04-22 13:13:11 [manheim.gb] INFO: Scrape type for 2486790: 0
2026-04-22 13:13:11 [manheim.gb] INFO: Found listing with ID: 2490146
2026-04-22 13:13:11 [manheim.gb] INFO: Scrape type for 2490146: 0
2026-04-22 13:13:11 [manheim.gb] INFO: Found listing with ID: 2498666
2026-04-22 13:13:11 [manheim.gb] INFO: Scrape type for 2498666: 0
2026-04-22 13:13:11 [manheim.gb] INFO: Found listing with ID: 2499928
2026-04-22 13:13:11 [manheim.gb] INFO: Scrape type for 2499928: 0
2026-04-22 13:13:11 [manheim.gb] INFO: Found listing with ID: 2504332
2026-04-22 13:13:11 [manheim.gb] INFO: Scrape type for 2504332: 0
2026-04-22 13:13:11 [manheim.gb] INFO: Found listing with ID: 2506745
2026-04-22 13:13:11 [manheim.gb] INFO: Scrape type for 2506745: 1
2026-04-22 13:13:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 437a650d-3278-5405-84ca-d790beeb3253 with identifier: 2461022
2026-04-22 13:13:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 437a650d-3278-5405-84ca-d790beeb3253 with identifier: 2461022
2026-04-22 13:13:11 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 437a650d-3278-5405-84ca-d790beeb3253 with identifier: 2461022 to the API
2026-04-22 13:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:11 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 437a650d-3278-5405-84ca-d790beeb3253: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:10 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:11 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:11 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '437a650d-3278-5405-84ca-d790beeb3253',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BP17NJV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/X-TRAIL?id=2461022',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'X-TRAIL',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-05-31',
 'seller_name': None,
 'title': 'NISSAN X-TRAIL 1.6 dCi N-Vision 5dr',
 'transmission': 'manual',
 'trim': '1.6 dCi N-Vision 5dr',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:11 [manheim.gb] INFO: Saving data for 2461022: {'created_time': 1776863591.405397, 'last_price_update_time': 1776863591.405408}
2026-04-22 13:13:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 26ea92d6-e96c-5ccc-9b25-dde6d17219fb with identifier: 2463386
2026-04-22 13:13:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 26ea92d6-e96c-5ccc-9b25-dde6d17219fb with identifier: 2463386
2026-04-22 13:13:11 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 26ea92d6-e96c-5ccc-9b25-dde6d17219fb with identifier: 2463386 to the API
2026-04-22 13:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '26ea92d6-e96c-5ccc-9b25-dde6d17219fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BC17OGL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2463386',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 61911,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-06-30',
 'seller_name': None,
 'title': 'NISSAN JUKE 1.2 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T N-Connecta 5dr',
 'year': 2017}
2026-04-22 13:13:11 [manheim.gb] INFO: Saving data for 2463386: {'created_time': 1776247799.301501, 'last_price_update_time': 1776863591.759098}
2026-04-22 13:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_7.jpg> (referer: None)
2026-04-22 13:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_7.jpg> (referer: None)
2026-04-22 13:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_4.jpg not downloaded yet
2026-04-22 13:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:11 [manheim.gb] INFO: Found listing with ID: 2512088
2026-04-22 13:13:11 [manheim.gb] INFO: Scrape type for 2512088: 0
2026-04-22 13:13:11 [manheim.gb] INFO: Found listing with ID: 2514914
2026-04-22 13:13:11 [manheim.gb] INFO: Scrape type for 2514914: 2
2026-04-22 13:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_11.jpg not downloaded yet
2026-04-22 13:13:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23be6e1b-76e3-5892-8318-6c433fa721fd with identifier: 2464383
2026-04-22 13:13:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23be6e1b-76e3-5892-8318-6c433fa721fd with scrape type 1
2026-04-22 13:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 23be6e1b-76e3-5892-8318-6c433fa721fd
2026-04-22 13:13:11 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 23be6e1b-76e3-5892-8318-6c433fa721fd
2026-04-22 13:13:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 23be6e1b-76e3-5892-8318-6c433fa721fd, identifier: 2464383
2026-04-22 13:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_6.jpg> (referer: None)
2026-04-22 13:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:11 [manheim.gb] INFO: Found listing with ID: 2514987
2026-04-22 13:13:11 [manheim.gb] INFO: Scrape type for 2514987: 0
2026-04-22 13:13:11 [manheim.gb] INFO: Found listing with ID: 2516091
2026-04-22 13:13:12 [manheim.gb] INFO: Scrape type for 2516091: 1
2026-04-22 13:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 23be6e1b-76e3-5892-8318-6c433fa721fd with identifier: 2464383
2026-04-22 13:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 23be6e1b-76e3-5892-8318-6c433fa721fd with identifier: 2464383
2026-04-22 13:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 23be6e1b-76e3-5892-8318-6c433fa721fd with identifier: 2464383 to the API
2026-04-22 13:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:12 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 23be6e1b-76e3-5892-8318-6c433fa721fd: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:11 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:12 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:12 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '23be6e1b-76e3-5892-8318-6c433fa721fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'LG16XVE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/Q5?id=2464383',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-03-29',
 'seller_name': None,
 'title': 'AUDI Q5 2.0 TDI [190] Quattro S Line Plus 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TDI [190] Quattro S Line Plus 5dr S Tronic',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:12 [manheim.gb] INFO: Saving data for 2464383: {'created_time': 1776863592.321243, 'last_price_update_time': 1776863592.321253}
2026-04-22 13:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_1.jpg> (referer: None)
2026-04-22 13:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_10.jpg not downloaded yet
2026-04-22 13:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:12 [manheim.gb] INFO: Found listing with ID: 2532347
2026-04-22 13:13:12 [manheim.gb] INFO: Scrape type for 2532347: 0
2026-04-22 13:13:12 [manheim.gb] INFO: Found listing with ID: 2537955
2026-04-22 13:13:12 [manheim.gb] INFO: Scrape type for 2537955: 1
2026-04-22 13:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_5.jpg> (referer: None)
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_9.jpg not downloaded yet
2026-04-22 13:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05124d0>
2026-04-22 13:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_7.jpg saved to cache
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5638551-d571-5aba-9c4c-1e4586af9e10
2026-04-22 13:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b104b450>
2026-04-22 13:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_7.jpg saved to cache
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5638551-d571-5aba-9c4c-1e4586af9e10
2026-04-22 13:13:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96bfe6c5-7d61-56ab-8b53-a676e7681e9a with identifier: 2469559
2026-04-22 13:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96bfe6c5-7d61-56ab-8b53-a676e7681e9a with scrape type 1
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 96bfe6c5-7d61-56ab-8b53-a676e7681e9a
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 96bfe6c5-7d61-56ab-8b53-a676e7681e9a
2026-04-22 13:13:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 96bfe6c5-7d61-56ab-8b53-a676e7681e9a, identifier: 2469559
2026-04-22 13:13:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89b1fe7c-fb09-55af-8748-15437187203c with identifier: 2472180
2026-04-22 13:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89b1fe7c-fb09-55af-8748-15437187203c with scrape type 1
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89b1fe7c-fb09-55af-8748-15437187203c
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2472180-4136241-13.jpg not downloaded yet
2026-04-22 13:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1729810>
2026-04-22 13:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_6.jpg saved to cache
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5638551-d571-5aba-9c4c-1e4586af9e10
2026-04-22 13:13:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 417e2b61-1a79-5e32-8b2a-37c3fd9b5733 with identifier: 2466891
2026-04-22 13:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733 with scrape type 1
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733
2026-04-22 13:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2466891-4167303-13.jpg not downloaded yet
2026-04-22 13:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_4.jpg> (referer: None)
2026-04-22 13:13:12 [manheim.gb] INFO: Found listing with ID: 253807
2026-04-22 13:13:12 [manheim.gb] INFO: Scrape type for 253807: 0
2026-04-22 13:13:12 [manheim.gb] INFO: Found listing with ID: 2544669
2026-04-22 13:13:12 [manheim.gb] INFO: Scrape type for 2544669: 1
2026-04-22 13:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 96bfe6c5-7d61-56ab-8b53-a676e7681e9a with identifier: 2469559
2026-04-22 13:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 96bfe6c5-7d61-56ab-8b53-a676e7681e9a with identifier: 2469559
2026-04-22 13:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 96bfe6c5-7d61-56ab-8b53-a676e7681e9a with identifier: 2469559 to the API
2026-04-22 13:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'Red',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '96bfe6c5-7d61-56ab-8b53-a676e7681e9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BG69BWJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=2469559',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'CITROEN',
 'model': 'C3',
 'odometer': 78701,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-09-27',
 'seller_name': None,
 'title': 'CITROEN C3 1.2 PureTech 83 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 83 Flair 5dr',
 'year': 2019}
2026-04-22 13:13:13 [manheim.gb] INFO: Saving data for 2469559: {'created_time': 1776863593.169404, 'last_price_update_time': 1776863593.169418}
2026-04-22 13:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_2.jpg not downloaded yet
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_7.jpg not downloaded yet
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_7.jpg not downloaded yet
2026-04-22 13:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:13 [manheim.gb] INFO: Found listing with ID: 2545463
2026-04-22 13:13:13 [manheim.gb] INFO: Scrape type for 2545463: 1
2026-04-22 13:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06daed0>
2026-04-22 13:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_1.jpg saved to cache
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5638551-d571-5aba-9c4c-1e4586af9e10
2026-04-22 13:13:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab57ffd8-cecf-5ff1-be8d-d3efc8836c06 with identifier: 2482676
2026-04-22 13:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab57ffd8-cecf-5ff1-be8d-d3efc8836c06 with scrape type 1
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ab57ffd8-cecf-5ff1-be8d-d3efc8836c06
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ab57ffd8-cecf-5ff1-be8d-d3efc8836c06
2026-04-22 13:13:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ab57ffd8-cecf-5ff1-be8d-d3efc8836c06, identifier: 2482676
2026-04-22 13:13:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b2d0a75-598d-5b7f-9167-3d4242b41250 with identifier: 2475613
2026-04-22 13:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b2d0a75-598d-5b7f-9167-3d4242b41250 with scrape type 1
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b2d0a75-598d-5b7f-9167-3d4242b41250
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-007.jpg not downloaded yet
2026-04-22 13:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16fca90>
2026-04-22 13:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_5.jpg saved to cache
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5638551-d571-5aba-9c4c-1e4586af9e10
2026-04-22 13:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_11.jpg> (referer: None)
2026-04-22 13:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_4.jpg not downloaded yet
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_4.jpg not downloaded yet
2026-04-22 13:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ab57ffd8-cecf-5ff1-be8d-d3efc8836c06 with identifier: 2482676
2026-04-22 13:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ab57ffd8-cecf-5ff1-be8d-d3efc8836c06 with identifier: 2482676
2026-04-22 13:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ab57ffd8-cecf-5ff1-be8d-d3efc8836c06 with identifier: 2482676 to the API
2026-04-22 13:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:13 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id ab57ffd8-cecf-5ff1-be8d-d3efc8836c06: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:13 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:13 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:13 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester - In Transit',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'ab57ffd8-cecf-5ff1-be8d-d3efc8836c06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DE59ZWX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2482676',
 'listing': 'auction',
 'location': 'Manchester - In Transit',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2009-10-31',
 'seller_name': None,
 'title': 'VAUXHALL CORSA 1.2i 16V Design 5dr',
 'transmission': 'manual',
 'trim': '1.2i 16V Design 5dr',
 'year': 2009}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:13 [manheim.gb] INFO: Saving data for 2482676: {'created_time': 1776863593.829834, 'last_price_update_time': 1776863593.829846}
2026-04-22 13:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16fc610>
2026-04-22 13:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_4.jpg saved to cache
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5638551-d571-5aba-9c4c-1e4586af9e10
2026-04-22 13:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_10.jpg> (referer: None)
2026-04-22 13:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:13 [manheim.gb] INFO: Found listing with ID: 254933
2026-04-22 13:13:13 [manheim.gb] INFO: Scrape type for 254933: 2
2026-04-22 13:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-009.jpg not downloaded yet
2026-04-22 13:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_3.jpg not downloaded yet
2026-04-22 13:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_3.jpg not downloaded yet
2026-04-22 13:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09b5777a-f664-5418-a908-7af6ff28b467 with identifier: 2506745
2026-04-22 13:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09b5777a-f664-5418-a908-7af6ff28b467 with scrape type 1
2026-04-22 13:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09b5777a-f664-5418-a908-7af6ff28b467
2026-04-22 13:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2506745-4170373-13.jpg not downloaded yet
2026-04-22 13:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a6dcf4a-e043-5131-a751-cb5433bd24ed with identifier: 2514914
2026-04-22 13:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a6dcf4a-e043-5131-a751-cb5433bd24ed with scrape type 2
2026-04-22 13:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a6dcf4a-e043-5131-a751-cb5433bd24ed with scrape type 2
2026-04-22 13:13:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8a6dcf4a-e043-5131-a751-cb5433bd24ed, identifier: 2514914
2026-04-22 13:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_9.jpg> (referer: None)
2026-04-22 13:13:14 [manheim.gb] INFO: Found listing with ID: 2549494
2026-04-22 13:13:14 [manheim.gb] INFO: Scrape type for 2549494: 1
2026-04-22 13:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-010.jpg not downloaded yet
2026-04-22 13:13:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8a6dcf4a-e043-5131-a751-cb5433bd24ed with identifier: 2514914
2026-04-22 13:13:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8a6dcf4a-e043-5131-a751-cb5433bd24ed with identifier: 2514914
2026-04-22 13:13:14 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8a6dcf4a-e043-5131-a751-cb5433bd24ed with identifier: 2514914 to the API
2026-04-22 13:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Shotts',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '8a6dcf4a-e043-5131-a751-cb5433bd24ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KR68ENT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/EXPERT?id=2514914',
 'listing': 'auction',
 'location': 'Shotts',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 147652,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-11-26',
 'seller_name': None,
 'title': 'PEUGEOT EXPERT 1400 2.0 BlueHDi 120 Professional Van Low Roof',
 'transmission': 'manual',
 'trim': '1400 2.0 BlueHDi 120 Professional Van Low Roof',
 'year': 2018}
2026-04-22 13:13:14 [manheim.gb] INFO: Saving data for 2514914: {'created_time': 1776247799.634641, 'last_price_update_time': 1776863594.501324}
2026-04-22 13:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06da590>
2026-04-22 13:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_11.jpg saved to cache
2026-04-22 13:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5638551-d571-5aba-9c4c-1e4586af9e10
2026-04-22 13:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb86be5-f50f-598c-9070-d4059e998797 with identifier: 2516091
2026-04-22 13:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb86be5-f50f-598c-9070-d4059e998797 with scrape type 1
2026-04-22 13:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item cfb86be5-f50f-598c-9070-d4059e998797
2026-04-22 13:13:14 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item cfb86be5-f50f-598c-9070-d4059e998797
2026-04-22 13:13:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cfb86be5-f50f-598c-9070-d4059e998797, identifier: 2516091
2026-04-22 13:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_5.jpg not downloaded yet
2026-04-22 13:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_5.jpg not downloaded yet
2026-04-22 13:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_7.jpg not downloaded yet
2026-04-22 13:13:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cfb86be5-f50f-598c-9070-d4059e998797 with identifier: 2516091
2026-04-22 13:13:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cfb86be5-f50f-598c-9070-d4059e998797 with identifier: 2516091
2026-04-22 13:13:14 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cfb86be5-f50f-598c-9070-d4059e998797 with identifier: 2516091 to the API
2026-04-22 13:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:14 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id cfb86be5-f50f-598c-9070-d4059e998797: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:14 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:14 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:14 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '4.4L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'cfb86be5-f50f-598c-9070-d4059e998797',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'LG65NFF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGE%20ROVER?id=2516091',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-10-02',
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER 4.4 SDV8 Autobiography 4dr Auto',
 'transmission': 'automatic',
 'trim': '4.4 SDV8 Autobiography 4dr Auto',
 'year': 2015}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:14 [manheim.gb] INFO: Saving data for 2516091: {'created_time': 1776863594.985503, 'last_price_update_time': 1776863594.985514}
2026-04-22 13:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:15 [manheim.gb] INFO: Found listing with ID: 2550798
2026-04-22 13:13:15 [manheim.gb] INFO: Scrape type for 2550798: 0
2026-04-22 13:13:15 [manheim.gb] INFO: Found listing with ID: 2554095
2026-04-22 13:13:15 [manheim.gb] INFO: Scrape type for 2554095: 1
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-012.jpg not downloaded yet
2026-04-22 13:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2466891-4167303-13.jpg> (referer: None)
2026-04-22 13:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2472180-4136241-13.jpg> (referer: None)
2026-04-22 13:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_7.jpg> (referer: None)
2026-04-22 13:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_7.jpg> (referer: None)
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_2.jpg not downloaded yet
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_2.jpg not downloaded yet
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_7.jpg not downloaded yet
2026-04-22 13:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b061e0d0>
2026-04-22 13:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_10.jpg saved to cache
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5638551-d571-5aba-9c4c-1e4586af9e10
2026-04-22 13:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f100471f-252a-5bbe-9ae2-f70a7ca6b753 with identifier: 2537955
2026-04-22 13:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f100471f-252a-5bbe-9ae2-f70a7ca6b753 with scrape type 1
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f100471f-252a-5bbe-9ae2-f70a7ca6b753
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f100471f-252a-5bbe-9ae2-f70a7ca6b753
2026-04-22 13:13:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f100471f-252a-5bbe-9ae2-f70a7ca6b753, identifier: 2537955
2026-04-22 13:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1895690>
2026-04-22 13:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_9.jpg saved to cache
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5638551-d571-5aba-9c4c-1e4586af9e10
2026-04-22 13:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-007.jpg> (referer: None)
2026-04-22 13:13:15 [manheim.gb] INFO: Found listing with ID: 2562192
2026-04-22 13:13:15 [manheim.gb] INFO: Scrape type for 2562192: 1
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-011.jpg not downloaded yet
2026-04-22 13:13:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f100471f-252a-5bbe-9ae2-f70a7ca6b753 with identifier: 2537955
2026-04-22 13:13:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f100471f-252a-5bbe-9ae2-f70a7ca6b753 with identifier: 2537955
2026-04-22 13:13:15 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f100471f-252a-5bbe-9ae2-f70a7ca6b753 with identifier: 2537955 to the API
2026-04-22 13:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'f100471f-252a-5bbe-9ae2-f70a7ca6b753',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'LD13MRX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/TRANSIT?id=2537955',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'longitude': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 107396,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2013-05-31',
 'seller_name': None,
 'title': 'FORD TRANSIT Low Roof Van TDCi 100ps',
 'transmission': 'manual',
 'trim': 'Low Roof Van TDCi 100ps',
 'year': 2013}
2026-04-22 13:13:15 [manheim.gb] INFO: Saving data for 2537955: {'created_time': 1776863595.689748, 'last_price_update_time': 1776863595.689763}
2026-04-22 13:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_2.jpg> (referer: None)
2026-04-22 13:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_4.jpg> (referer: None)
2026-04-22 13:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_9.jpg not downloaded yet
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_9.jpg not downloaded yet
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_6.jpg not downloaded yet
2026-04-22 13:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21cc5446-67bb-5373-8587-5de656b3ba02 with identifier: 2544669
2026-04-22 13:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21cc5446-67bb-5373-8587-5de656b3ba02 with scrape type 1
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 21cc5446-67bb-5373-8587-5de656b3ba02
2026-04-22 13:13:15 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 21cc5446-67bb-5373-8587-5de656b3ba02
2026-04-22 13:13:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 21cc5446-67bb-5373-8587-5de656b3ba02, identifier: 2544669
2026-04-22 13:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_4.jpg> (referer: None)
2026-04-22 13:13:15 [manheim.gb] INFO: Found listing with ID: 2562505
2026-04-22 13:13:15 [manheim.gb] INFO: Scrape type for 2562505: 0
2026-04-22 13:13:15 [manheim.gb] INFO: Found listing with ID: 2563648
2026-04-22 13:13:15 [manheim.gb] INFO: Scrape type for 2563648: 0
2026-04-22 13:13:15 [manheim.gb] INFO: Found listing with ID: 2564646
2026-04-22 13:13:15 [manheim.gb] INFO: Scrape type for 2564646: 0
2026-04-22 13:13:15 [manheim.gb] INFO: Found listing with ID: 2567711
2026-04-22 13:13:15 [manheim.gb] INFO: Scrape type for 2567711: 0
2026-04-22 13:13:15 [manheim.gb] INFO: Found listing with ID: 2567755
2026-04-22 13:13:16 [manheim.gb] INFO: Scrape type for 2567755: 0
2026-04-22 13:13:16 [manheim.gb] INFO: Found listing with ID: 2570609
2026-04-22 13:13:16 [manheim.gb] INFO: Scrape type for 2570609: 0
2026-04-22 13:13:16 [manheim.gb] INFO: Found listing with ID: 2585727
2026-04-22 13:13:16 [manheim.gb] INFO: Scrape type for 2585727: 2
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2475613-4164462-13.jpg not downloaded yet
2026-04-22 13:13:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 21cc5446-67bb-5373-8587-5de656b3ba02 with identifier: 2544669
2026-04-22 13:13:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 21cc5446-67bb-5373-8587-5de656b3ba02 with identifier: 2544669
2026-04-22 13:13:16 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 21cc5446-67bb-5373-8587-5de656b3ba02 with identifier: 2544669 to the API
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:16 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 21cc5446-67bb-5373-8587-5de656b3ba02: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:15 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:16 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:16 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '21cc5446-67bb-5373-8587-5de656b3ba02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BF17AOS',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=2544669',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'ASTRA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-05-02',
 'seller_name': None,
 'title': 'VAUXHALL ASTRA 1.4T 16V 125 Design 5dr',
 'transmission': 'manual',
 'trim': '1.4T 16V 125 Design 5dr',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:16 [manheim.gb] INFO: Saving data for 2544669: {'created_time': 1776863596.436893, 'last_price_update_time': 1776863596.436904}
2026-04-22 13:13:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb795cc-6134-5acf-8853-1847b70f3518 with identifier: 2545463
2026-04-22 13:13:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb795cc-6134-5acf-8853-1847b70f3518 with scrape type 1
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item acb795cc-6134-5acf-8853-1847b70f3518
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2545463-2792567-13.jpg not downloaded yet
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16524d0>
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2466891-4167303-13.jpg saved to cache
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0733950>
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2472180-4136241-13.jpg saved to cache
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89b1fe7c-fb09-55af-8748-15437187203c
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1629ed0>
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_7.jpg saved to cache
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2b009d0>
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_7.jpg saved to cache
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89b1fe7c-fb09-55af-8748-15437187203c
2026-04-22 13:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_10.jpg not downloaded yet
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_10.jpg not downloaded yet
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_1.jpg not downloaded yet
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06d8ed0>
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-007.jpg saved to cache
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b2d0a75-598d-5b7f-9167-3d4242b41250
2026-04-22 13:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:16 [manheim.gb] INFO: Found listing with ID: 2586540
2026-04-22 13:13:16 [manheim.gb] INFO: Scrape type for 2586540: 0
2026-04-22 13:13:16 [manheim.gb] INFO: Found listing with ID: 2587152
2026-04-22 13:13:16 [manheim.gb] INFO: Scrape type for 2587152: 0
2026-04-22 13:13:16 [manheim.gb] INFO: Found listing with ID: 2587159
2026-04-22 13:13:16 [manheim.gb] INFO: Scrape type for 2587159: 0
2026-04-22 13:13:16 [manheim.gb] INFO: Found listing with ID: 2591496
2026-04-22 13:13:16 [manheim.gb] INFO: Scrape type for 2591496: 1
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-006.jpg not downloaded yet
2026-04-22 13:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_7.jpg not downloaded yet
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b076c290>
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_2.jpg saved to cache
2026-04-22 13:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5638551-d571-5aba-9c4c-1e4586af9e10
2026-04-22 13:13:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5638551-d571-5aba-9c4c-1e4586af9e10, skipping ID generation
2026-04-22 13:13:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5638551-d571-5aba-9c4c-1e4586af9e10 with scrape type 1
2026-04-22 13:13:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5638551-d571-5aba-9c4c-1e4586af9e10 sending to next pipeline
2026-04-22 13:13:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a5638551-d571-5aba-9c4c-1e4586af9e10, identifier: 2409563
2026-04-22 13:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0641990>
2026-04-22 13:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_4.jpg saved to cache
2026-04-22 13:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733
2026-04-22 13:13:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65af3803-4e0a-5041-a313-41bdf9c7947a with identifier: 254933
2026-04-22 13:13:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65af3803-4e0a-5041-a313-41bdf9c7947a with scrape type 2
2026-04-22 13:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65af3803-4e0a-5041-a313-41bdf9c7947a with scrape type 2
2026-04-22 13:13:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 65af3803-4e0a-5041-a313-41bdf9c7947a, identifier: 254933
2026-04-22 13:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_3.jpg> (referer: None)
2026-04-22 13:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_3.jpg> (referer: None)
2026-04-22 13:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_7.jpg> (referer: None)
2026-04-22 13:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_11.jpg not downloaded yet
2026-04-22 13:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_11.jpg not downloaded yet
2026-04-22 13:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_5.jpg not downloaded yet
2026-04-22 13:13:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a5638551-d571-5aba-9c4c-1e4586af9e10 with identifier: 2409563
2026-04-22 13:13:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a5638551-d571-5aba-9c4c-1e4586af9e10 with identifier: 2409563
2026-04-22 13:13:17 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a5638551-d571-5aba-9c4c-1e4586af9e10 with identifier: 2409563 to the API
2026-04-22 13:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:17 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'a5638551-d571-5aba-9c4c-1e4586af9e10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'EX66UOT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2409563',
 'listing': 'auction',
 'location': 'Birmingham',
 'longitude': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 123572,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198896,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198896,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237936,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259486,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186846,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194300,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187476,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191522,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196102,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5638551-d571-5aba-9c4c-1e4586af9e10/a5638551-d571-5aba-9c4c-1e4586af9e10_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293748,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7de20c30-6b88-4c86-ba69-6c396f0648af_ext_2.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-09-01',
 'seller_name': None,
 'title': 'FORD FIESTA 1.0 EcoBoost 140 ST-Line 3dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 140 ST-Line 3dr',
 'year': 2016}
2026-04-22 13:13:17 [manheim.gb] INFO: Saving data for 2409563: {'created_time': 1776863597.697728, 'last_price_update_time': 1776863597.697738}
2026-04-22 13:13:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 65af3803-4e0a-5041-a313-41bdf9c7947a with identifier: 254933
2026-04-22 13:13:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 65af3803-4e0a-5041-a313-41bdf9c7947a with identifier: 254933
2026-04-22 13:13:17 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 65af3803-4e0a-5041-a313-41bdf9c7947a with identifier: 254933 to the API
2026-04-22 13:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '65af3803-4e0a-5041-a313-41bdf9c7947a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KY64TVJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/CITIGO?id=254933',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'SKODA',
 'model': 'CITIGO',
 'odometer': 46451,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2015-01-15',
 'seller_name': None,
 'title': 'SKODA CITIGO 1.0 MPI GreenTech Elegance 3dr',
 'transmission': 'manual',
 'trim': '1.0 MPI GreenTech Elegance 3dr',
 'year': 2015}
2026-04-22 13:13:18 [manheim.gb] INFO: Saving data for 254933: {'created_time': 1776247800.86839, 'last_price_update_time': 1776863598.048898}
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16877d0>
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_4.jpg saved to cache
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89b1fe7c-fb09-55af-8748-15437187203c
2026-04-22 13:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-009.jpg> (referer: None)
2026-04-22 13:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:18 [manheim.gb] INFO: Found listing with ID: 2596287
2026-04-22 13:13:18 [manheim.gb] INFO: Scrape type for 2596287: 1
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-005.jpg not downloaded yet
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_4.jpg not downloaded yet
2026-04-22 13:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2506745-4170373-13.jpg> (referer: None)
2026-04-22 13:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_5.jpg> (referer: None)
2026-04-22 13:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_5.jpg> (referer: None)
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_4.jpg not downloaded yet
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_4.jpg not downloaded yet
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_4.jpg not downloaded yet
2026-04-22 13:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8b2a6fc-1aa4-54bb-b550-14f43495f653 with identifier: 2549494
2026-04-22 13:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8b2a6fc-1aa4-54bb-b550-14f43495f653 with scrape type 1
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8b2a6fc-1aa4-54bb-b550-14f43495f653
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2549494-4168819-13.jpg not downloaded yet
2026-04-22 13:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc18549f-628c-5d11-975b-6e50df5b0b1f with identifier: 2554095
2026-04-22 13:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc18549f-628c-5d11-975b-6e50df5b0b1f with scrape type 1
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item cc18549f-628c-5d11-975b-6e50df5b0b1f
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item cc18549f-628c-5d11-975b-6e50df5b0b1f
2026-04-22 13:13:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cc18549f-628c-5d11-975b-6e50df5b0b1f, identifier: 2554095
2026-04-22 13:13:18 [manheim.gb] INFO: Found listing with ID: 2604868
2026-04-22 13:13:18 [manheim.gb] INFO: Scrape type for 2604868: 1
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-003.jpg not downloaded yet
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_3.jpg not downloaded yet
2026-04-22 13:13:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cc18549f-628c-5d11-975b-6e50df5b0b1f with identifier: 2554095
2026-04-22 13:13:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cc18549f-628c-5d11-975b-6e50df5b0b1f with identifier: 2554095
2026-04-22 13:13:18 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cc18549f-628c-5d11-975b-6e50df5b0b1f with identifier: 2554095 to the API
2026-04-22 13:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'cc18549f-628c-5d11-975b-6e50df5b0b1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KP19AHG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=2554095',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 31832,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-04-09',
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PureTech Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure 5dr',
 'year': 2019}
2026-04-22 13:13:18 [manheim.gb] INFO: Saving data for 2554095: {'created_time': 1776863598.78516, 'last_price_update_time': 1776863598.785173}
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b054c750>
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_3.jpg saved to cache
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0ff3550>
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_3.jpg saved to cache
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89b1fe7c-fb09-55af-8748-15437187203c
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16288d0>
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_7.jpg saved to cache
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09b5777a-f664-5418-a908-7af6ff28b467
2026-04-22 13:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-010.jpg> (referer: None)
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_11.jpg not downloaded yet
2026-04-22 13:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_7.jpg not downloaded yet
2026-04-22 13:13:18 [manheim.gb] INFO: Found listing with ID: 2607333
2026-04-22 13:13:19 [manheim.gb] INFO: Scrape type for 2607333: 1
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-002.jpg not downloaded yet
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_5.jpg not downloaded yet
2026-04-22 13:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_7.jpg> (referer: None)
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_10.jpg not downloaded yet
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_4.jpg not downloaded yet
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04de3d0>
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-009.jpg saved to cache
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b2d0a75-598d-5b7f-9167-3d4242b41250
2026-04-22 13:13:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ffb9592-bbd8-5dfe-97d1-114bf21373c8 with identifier: 2562192
2026-04-22 13:13:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ffb9592-bbd8-5dfe-97d1-114bf21373c8 with scrape type 1
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 5ffb9592-bbd8-5dfe-97d1-114bf21373c8
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 5ffb9592-bbd8-5dfe-97d1-114bf21373c8
2026-04-22 13:13:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5ffb9592-bbd8-5dfe-97d1-114bf21373c8, identifier: 2562192
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14d9710>
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2506745-4170373-13.jpg saved to cache
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09b5777a-f664-5418-a908-7af6ff28b467
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05748d0>
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_5.jpg saved to cache
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89b1fe7c-fb09-55af-8748-15437187203c
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b072f4d0>
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_5.jpg saved to cache
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733
2026-04-22 13:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-012.jpg> (referer: None)
2026-04-22 13:13:19 [manheim.gb] INFO: Found listing with ID: 2610165
2026-04-22 13:13:19 [manheim.gb] INFO: Scrape type for 2610165: 0
2026-04-22 13:13:19 [manheim.gb] INFO: Found listing with ID: 2618651
2026-04-22 13:13:19 [manheim.gb] INFO: Scrape type for 2618651: 1
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_2.jpg not downloaded yet
2026-04-22 13:13:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5ffb9592-bbd8-5dfe-97d1-114bf21373c8 with identifier: 2562192
2026-04-22 13:13:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5ffb9592-bbd8-5dfe-97d1-114bf21373c8 with identifier: 2562192
2026-04-22 13:13:19 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5ffb9592-bbd8-5dfe-97d1-114bf21373c8 with identifier: 2562192 to the API
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:19 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 5ffb9592-bbd8-5dfe-97d1-114bf21373c8: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:19 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:19 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:19 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '5ffb9592-bbd8-5dfe-97d1-114bf21373c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'NG68LPF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CLA?id=2562192',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-01-21',
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 180 AMG Line Edition 4dr',
 'transmission': 'manual',
 'trim': 'CLA 180 AMG Line Edition 4dr',
 'year': 2019}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:19 [manheim.gb] INFO: Saving data for 2562192: {'created_time': 1776863599.765494, 'last_price_update_time': 1776863599.765505}
2026-04-22 13:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_2.jpg> (referer: None)
2026-04-22 13:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_2.jpg> (referer: None)
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_9.jpg not downloaded yet
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_3.jpg not downloaded yet
2026-04-22 13:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-011.jpg> (referer: None)
2026-04-22 13:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_6.jpg> (referer: None)
2026-04-22 13:13:19 [manheim.gb] INFO: Found listing with ID: 2626470
2026-04-22 13:13:19 [manheim.gb] INFO: Scrape type for 2626470: 0
2026-04-22 13:13:19 [manheim.gb] INFO: Found listing with ID: 2634964
2026-04-22 13:13:19 [manheim.gb] INFO: Scrape type for 2634964: 1
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_9.jpg not downloaded yet
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0509710>
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-010.jpg saved to cache
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b2d0a75-598d-5b7f-9167-3d4242b41250
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0552050>
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_7.jpg saved to cache
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09b5777a-f664-5418-a908-7af6ff28b467
2026-04-22 13:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2545463-2792567-13.jpg> (referer: None)
2026-04-22 13:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_1.jpg> (referer: None)
2026-04-22 13:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_5.jpg not downloaded yet
2026-04-22 13:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_10.jpg> (referer: None)
2026-04-22 13:13:19 [manheim.gb] INFO: Found listing with ID: 2635347
2026-04-22 13:13:20 [manheim.gb] INFO: Scrape type for 2635347: 1
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_10.jpg not downloaded yet
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b17482d0>
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-012.jpg saved to cache
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b2d0a75-598d-5b7f-9167-3d4242b41250
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_2.jpg not downloaded yet
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05454d0>
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_2.jpg saved to cache
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b17048d0>
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_2.jpg saved to cache
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89b1fe7c-fb09-55af-8748-15437187203c
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b188d9d0>
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-011.jpg saved to cache
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b2d0a75-598d-5b7f-9167-3d4242b41250
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1706d10>
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_6.jpg saved to cache
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09b5777a-f664-5418-a908-7af6ff28b467
2026-04-22 13:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:20 [manheim.gb] INFO: Found listing with ID: 2638947
2026-04-22 13:13:20 [manheim.gb] INFO: Scrape type for 2638947: 0
2026-04-22 13:13:20 [manheim.gb] INFO: Found listing with ID: 2640293
2026-04-22 13:13:20 [manheim.gb] INFO: Scrape type for 2640293: 0
2026-04-22 13:13:20 [manheim.gb] INFO: Found listing with ID: 2642820
2026-04-22 13:13:20 [manheim.gb] INFO: Scrape type for 2642820: 1
2026-04-22 13:13:20 [manheim.gb] ERROR: Error extracting listing 2642820: Field transmission is not nullable
2026-04-22 13:13:20 [manheim.gb] INFO: Found listing with ID: 2650784
2026-04-22 13:13:20 [manheim.gb] INFO: Scrape type for 2650784: 1
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_11.jpg not downloaded yet
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_9.jpg not downloaded yet
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1775f90>
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2545463-2792567-13.jpg saved to cache
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acb795cc-6134-5acf-8853-1847b70f3518
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b065d650>
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_1.jpg saved to cache
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09b5777a-f664-5418-a908-7af6ff28b467
2026-04-22 13:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_10.jpg> (referer: None)
2026-04-22 13:13:20 [manheim.gb] INFO: Found listing with ID: 2651724
2026-04-22 13:13:20 [manheim.gb] INFO: Scrape type for 2651724: 0
2026-04-22 13:13:20 [manheim.gb] INFO: Found listing with ID: 2652779
2026-04-22 13:13:20 [manheim.gb] INFO: Scrape type for 2652779: 1
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_4.jpg not downloaded yet
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05d5ad0>
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_10.jpg saved to cache
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733
2026-04-22 13:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_7.jpg> (referer: None)
2026-04-22 13:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-006.jpg> (referer: None)
2026-04-22 13:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_5.jpg> (referer: None)
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_10.jpg not downloaded yet
2026-04-22 13:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_11.jpg> (referer: None)
2026-04-22 13:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_7.jpg> (referer: None)
2026-04-22 13:13:20 [manheim.gb] INFO: Found listing with ID: 265279
2026-04-22 13:13:20 [manheim.gb] INFO: Scrape type for 265279: 0
2026-04-22 13:13:20 [manheim.gb] INFO: Found listing with ID: 265624
2026-04-22 13:13:20 [manheim.gb] INFO: Scrape type for 265624: 0
2026-04-22 13:13:20 [manheim.gb] INFO: Found listing with ID: 2659619
2026-04-22 13:13:20 [manheim.gb] INFO: Scrape type for 2659619: 0
2026-04-22 13:13:20 [manheim.gb] INFO: Found listing with ID: 2666923
2026-04-22 13:13:20 [manheim.gb] INFO: Scrape type for 2666923: 0
2026-04-22 13:13:20 [manheim.gb] INFO: Found listing with ID: 2674877
2026-04-22 13:13:20 [manheim.gb] INFO: Scrape type for 2674877: 1
2026-04-22 13:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b764ce9-443b-57c5-ae76-66e2b59e1f5c with identifier: 2618651
2026-04-22 13:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b764ce9-443b-57c5-ae76-66e2b59e1f5c with scrape type 1
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 8b764ce9-443b-57c5-ae76-66e2b59e1f5c
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 8b764ce9-443b-57c5-ae76-66e2b59e1f5c
2026-04-22 13:13:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8b764ce9-443b-57c5-ae76-66e2b59e1f5c, identifier: 2618651
2026-04-22 13:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_11.jpg> (referer: None)
2026-04-22 13:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_11.jpg not downloaded yet
2026-04-22 13:13:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8b764ce9-443b-57c5-ae76-66e2b59e1f5c with identifier: 2618651
2026-04-22 13:13:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8b764ce9-443b-57c5-ae76-66e2b59e1f5c with identifier: 2618651
2026-04-22 13:13:21 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8b764ce9-443b-57c5-ae76-66e2b59e1f5c with identifier: 2618651 to the API
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '8b764ce9-443b-57c5-ae76-66e2b59e1f5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DE67KNV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/TT?id=2618651',
 'listing': 'auction',
 'location': 'Leeds',
 'longitude': None,
 'make': 'AUDI',
 'model': 'TT',
 'odometer': 109164,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-10-13',
 'seller_name': None,
 'title': 'AUDI TT 2.0T FSI Sport 2dr',
 'transmission': 'manual',
 'trim': '2.0T FSI Sport 2dr',
 'year': 2017}
2026-04-22 13:13:21 [manheim.gb] INFO: Saving data for 2618651: {'created_time': 1776863601.286014, 'last_price_update_time': 1776863601.286026}
2026-04-22 13:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2549494-4168819-13.jpg> (referer: None)
2026-04-22 13:13:21 [manheim.gb] INFO: Found listing with ID: 2679374
2026-04-22 13:13:21 [manheim.gb] INFO: Scrape type for 2679374: 0
2026-04-22 13:13:21 [manheim.gb] INFO: Found listing with ID: 2687379
2026-04-22 13:13:21 [manheim.gb] INFO: Scrape type for 2687379: 0
2026-04-22 13:13:21 [manheim.gb] INFO: Found listing with ID: 2687994
2026-04-22 13:13:21 [manheim.gb] INFO: Scrape type for 2687994: 0
2026-04-22 13:13:21 [manheim.gb] INFO: Found listing with ID: 2688921
2026-04-22 13:13:21 [manheim.gb] INFO: Scrape type for 2688921: 1
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_4.jpg not downloaded yet
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14db1d0>
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_10.jpg saved to cache
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89b1fe7c-fb09-55af-8748-15437187203c
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0773190>
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_7.jpg saved to cache
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acb795cc-6134-5acf-8853-1847b70f3518
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b181ce90>
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-006.jpg saved to cache
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b2d0a75-598d-5b7f-9167-3d4242b41250
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0772190>
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_5.jpg saved to cache
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09b5777a-f664-5418-a908-7af6ff28b467
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0579510>
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_11.jpg saved to cache
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06be310>
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_7.jpg saved to cache
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8b2a6fc-1aa4-54bb-b550-14f43495f653
2026-04-22 13:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_10.jpg> (referer: None)
2026-04-22 13:13:21 [manheim.gb] INFO: Found listing with ID: 2697638
2026-04-22 13:13:21 [manheim.gb] INFO: Scrape type for 2697638: 1
2026-04-22 13:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_5.jpg> (referer: None)
2026-04-22 13:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_2.jpg> (referer: None)
2026-04-22 13:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_9.jpg> (referer: None)
2026-04-22 13:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0509250>
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_11.jpg saved to cache
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89b1fe7c-fb09-55af-8748-15437187203c
2026-04-22 13:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_4.jpg> (referer: None)
2026-04-22 13:13:21 [manheim.gb] INFO: Found listing with ID: 2701197
2026-04-22 13:13:21 [manheim.gb] INFO: Scrape type for 2701197: 0
2026-04-22 13:13:21 [manheim.gb] INFO: Found listing with ID: 2707127
2026-04-22 13:13:21 [manheim.gb] INFO: Scrape type for 2707127: 1
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b077c4d0>
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2549494-4168819-13.jpg saved to cache
2026-04-22 13:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8b2a6fc-1aa4-54bb-b550-14f43495f653
2026-04-22 13:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_3.jpg> (referer: None)
2026-04-22 13:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_10.jpg> (referer: None)
2026-04-22 13:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_9.jpg> (referer: None)
2026-04-22 13:13:21 [manheim.gb] INFO: Found listing with ID: 2708208
2026-04-22 13:13:21 [manheim.gb] INFO: Scrape type for 2708208: 0
2026-04-22 13:13:21 [manheim.gb] INFO: Found listing with ID: 2709395
2026-04-22 13:13:21 [manheim.gb] INFO: Scrape type for 2709395: 0
2026-04-22 13:13:21 [manheim.gb] INFO: Found listing with ID: 2713213
2026-04-22 13:13:21 [manheim.gb] INFO: Scrape type for 2713213: 1
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05e1a50>
2026-04-22 13:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_10.jpg saved to cache
2026-04-22 13:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09b5777a-f664-5418-a908-7af6ff28b467
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1705610>
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_5.jpg saved to cache
2026-04-22 13:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acb795cc-6134-5acf-8853-1847b70f3518
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1194e10>
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_2.jpg saved to cache
2026-04-22 13:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acb795cc-6134-5acf-8853-1847b70f3518
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1691910>
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_9.jpg saved to cache
2026-04-22 13:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09b5777a-f664-5418-a908-7af6ff28b467
2026-04-22 13:13:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbed9d52-e6da-529d-9c55-9e1d795bcf1a with identifier: 2650784
2026-04-22 13:13:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbed9d52-e6da-529d-9c55-9e1d795bcf1a with scrape type 1
2026-04-22 13:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item bbed9d52-e6da-529d-9c55-9e1d795bcf1a
2026-04-22 13:13:22 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item bbed9d52-e6da-529d-9c55-9e1d795bcf1a
2026-04-22 13:13:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: bbed9d52-e6da-529d-9c55-9e1d795bcf1a, identifier: 2650784
2026-04-22 13:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:22 [manheim.gb] INFO: Found listing with ID: 271347
2026-04-22 13:13:22 [manheim.gb] INFO: Scrape type for 271347: 0
2026-04-22 13:13:22 [manheim.gb] INFO: Found listing with ID: 2715568
2026-04-22 13:13:22 [manheim.gb] INFO: Scrape type for 2715568: 0
2026-04-22 13:13:22 [manheim.gb] INFO: Found listing with ID: 2717091
2026-04-22 13:13:22 [manheim.gb] INFO: Scrape type for 2717091: 0
2026-04-22 13:13:22 [manheim.gb] INFO: Found listing with ID: 2729093
2026-04-22 13:13:22 [manheim.gb] INFO: Scrape type for 2729093: 1
2026-04-22 13:13:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: bbed9d52-e6da-529d-9c55-9e1d795bcf1a with identifier: 2650784
2026-04-22 13:13:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: bbed9d52-e6da-529d-9c55-9e1d795bcf1a with identifier: 2650784
2026-04-22 13:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: bbed9d52-e6da-529d-9c55-9e1d795bcf1a with identifier: 2650784 to the API
2026-04-22 13:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'bbed9d52-e6da-529d-9c55-9e1d795bcf1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BL19LKV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2650784',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 65000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-04-26',
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.3 DiG-T Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T Acenta Premium 5dr',
 'year': 2019}
2026-04-22 13:13:22 [manheim.gb] INFO: Saving data for 2650784: {'created_time': 1776863602.803326, 'last_price_update_time': 1776863602.803338}
2026-04-22 13:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0642ad0>
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_4.jpg saved to cache
2026-04-22 13:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8b2a6fc-1aa4-54bb-b550-14f43495f653
2026-04-22 13:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:22 [manheim.gb] INFO: Found listing with ID: 2732998
2026-04-22 13:13:23 [manheim.gb] INFO: Scrape type for 2732998: 1
2026-04-22 13:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_11.jpg> (referer: None)
2026-04-22 13:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_4.jpg> (referer: None)
2026-04-22 13:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_2.jpg> (referer: None)
2026-04-22 13:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_11.jpg> (referer: None)
2026-04-22 13:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_10.jpg> (referer: None)
2026-04-22 13:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14dba50>
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_3.jpg saved to cache
2026-04-22 13:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8b2a6fc-1aa4-54bb-b550-14f43495f653
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0febe10>
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_10.jpg saved to cache
2026-04-22 13:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acb795cc-6134-5acf-8853-1847b70f3518
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b188bb50>
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_9.jpg saved to cache
2026-04-22 13:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acb795cc-6134-5acf-8853-1847b70f3518
2026-04-22 13:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 539c6452-728e-5d80-9bc3-20b00adb0120 with identifier: 2688921
2026-04-22 13:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 539c6452-728e-5d80-9bc3-20b00adb0120 with scrape type 1
2026-04-22 13:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 539c6452-728e-5d80-9bc3-20b00adb0120
2026-04-22 13:13:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 539c6452-728e-5d80-9bc3-20b00adb0120
2026-04-22 13:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 539c6452-728e-5d80-9bc3-20b00adb0120, identifier: 2688921
2026-04-22 13:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_4.jpg> (referer: None)
2026-04-22 13:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_9.jpg> (referer: None)
2026-04-22 13:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:23 [manheim.gb] INFO: Found listing with ID: 2733084
2026-04-22 13:13:23 [manheim.gb] INFO: Scrape type for 2733084: 1
2026-04-22 13:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 539c6452-728e-5d80-9bc3-20b00adb0120 with identifier: 2688921
2026-04-22 13:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 539c6452-728e-5d80-9bc3-20b00adb0120 with identifier: 2688921
2026-04-22 13:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 539c6452-728e-5d80-9bc3-20b00adb0120 with identifier: 2688921 to the API
2026-04-22 13:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester - In Transit',
 'color': 'Red',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '539c6452-728e-5d80-9bc3-20b00adb0120',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'GJ17NFR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/TUCSON?id=2688921',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'longitude': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 48505,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-17',
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 2.0 CRDi Premium SE 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 CRDi Premium SE 5dr Auto',
 'year': 2017}
2026-04-22 13:13:23 [manheim.gb] INFO: Saving data for 2688921: {'created_time': 1776863603.70373, 'last_price_update_time': 1776863603.703744}
2026-04-22 13:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_5.jpg> (referer: None)
2026-04-22 13:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:23 [manheim.gb] INFO: Found listing with ID: 2733207
2026-04-22 13:13:23 [manheim.gb] INFO: Scrape type for 2733207: 1
2026-04-22 13:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee525069-5e23-5af8-b4ac-f3d5073bf0e4 with identifier: 2634964
2026-04-22 13:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee525069-5e23-5af8-b4ac-f3d5073bf0e4 with scrape type 1
2026-04-22 13:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ee525069-5e23-5af8-b4ac-f3d5073bf0e4
2026-04-22 13:13:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ee525069-5e23-5af8-b4ac-f3d5073bf0e4
2026-04-22 13:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ee525069-5e23-5af8-b4ac-f3d5073bf0e4, identifier: 2634964
2026-04-22 13:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0bdc547-579d-5095-a91c-08e84bb9dc07 with identifier: 2707127
2026-04-22 13:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0bdc547-579d-5095-a91c-08e84bb9dc07 with scrape type 1
2026-04-22 13:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e0bdc547-579d-5095-a91c-08e84bb9dc07
2026-04-22 13:13:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e0bdc547-579d-5095-a91c-08e84bb9dc07
2026-04-22 13:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e0bdc547-579d-5095-a91c-08e84bb9dc07, identifier: 2707127
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06fa550>
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_11.jpg saved to cache
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acb795cc-6134-5acf-8853-1847b70f3518
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0573910>
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_4.jpg saved to cache
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item acb795cc-6134-5acf-8853-1847b70f3518
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b102a090>
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_2.jpg saved to cache
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8b2a6fc-1aa4-54bb-b550-14f43495f653
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fb0810>
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_11.jpg saved to cache
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8b2a6fc-1aa4-54bb-b550-14f43495f653
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1607c90>
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_10.jpg saved to cache
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8b2a6fc-1aa4-54bb-b550-14f43495f653
2026-04-22 13:13:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 102b3a25-24b9-59e1-91e7-97ac9e3ac37a with identifier: 2674877
2026-04-22 13:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 102b3a25-24b9-59e1-91e7-97ac9e3ac37a with scrape type 1
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 102b3a25-24b9-59e1-91e7-97ac9e3ac37a
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 102b3a25-24b9-59e1-91e7-97ac9e3ac37a
2026-04-22 13:13:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 102b3a25-24b9-59e1-91e7-97ac9e3ac37a, identifier: 2674877
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b065f150>
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_4.jpg saved to cache
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8b2a6fc-1aa4-54bb-b550-14f43495f653
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0572010>
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_9.jpg saved to cache
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8b2a6fc-1aa4-54bb-b550-14f43495f653
2026-04-22 13:13:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd401410-ff54-5874-a6e1-9c297f8bedf7 with identifier: 2713213
2026-04-22 13:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd401410-ff54-5874-a6e1-9c297f8bedf7 with scrape type 1
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd401410-ff54-5874-a6e1-9c297f8bedf7
2026-04-22 13:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_ext_7.jpg not downloaded yet
2026-04-22 13:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_11.jpg> (referer: None)
2026-04-22 13:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_4.jpg> (referer: None)
2026-04-22 13:13:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ee525069-5e23-5af8-b4ac-f3d5073bf0e4 with identifier: 2634964
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Green HTTP/1.1" 200 None
2026-04-22 13:13:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:13:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ee525069-5e23-5af8-b4ac-f3d5073bf0e4 with identifier: 2634964
2026-04-22 13:13:24 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ee525069-5e23-5af8-b4ac-f3d5073bf0e4 with identifier: 2634964 to the API
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester - In Transit',
 'color': 'Green',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'ee525069-5e23-5af8-b4ac-f3d5073bf0e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'MV18XKE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/5008?id=2634964',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 86768,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-04-05',
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.6 BlueHDi 120 GT Line 5dr EAT6',
 'transmission': 'automatic',
 'trim': '1.6 BlueHDi 120 GT Line 5dr EAT6',
 'year': 2018}
2026-04-22 13:13:24 [manheim.gb] INFO: Saving data for 2634964: {'created_time': 1776863604.934585, 'last_price_update_time': 1776863604.934596}
2026-04-22 13:13:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e0bdc547-579d-5095-a91c-08e84bb9dc07 with identifier: 2707127
2026-04-22 13:13:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e0bdc547-579d-5095-a91c-08e84bb9dc07 with identifier: 2707127
2026-04-22 13:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e0bdc547-579d-5095-a91c-08e84bb9dc07 with identifier: 2707127 to the API
2026-04-22 13:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'e0bdc547-579d-5095-a91c-08e84bb9dc07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'BX16DWP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/INSIGNIA?id=2707127',
 'listing': 'auction',
 'location': 'Birmingham',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'INSIGNIA',
 'odometer': 93102,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-03-01',
 'seller_name': None,
 'title': 'VAUXHALL INSIGNIA 1.4T SRi Nav 5dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.4T SRi Nav 5dr [Start Stop]',
 'year': 2016}
2026-04-22 13:13:25 [manheim.gb] INFO: Saving data for 2707127: {'created_time': 1776863605.304167, 'last_price_update_time': 1776863605.30418}
2026-04-22 13:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 102b3a25-24b9-59e1-91e7-97ac9e3ac37a with identifier: 2674877
2026-04-22 13:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 102b3a25-24b9-59e1-91e7-97ac9e3ac37a with identifier: 2674877
2026-04-22 13:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 102b3a25-24b9-59e1-91e7-97ac9e3ac37a with identifier: 2674877 to the API
2026-04-22 13:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:25 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 102b3a25-24b9-59e1-91e7-97ac9e3ac37a: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:25 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:25 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:25 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '102b3a25-24b9-59e1-91e7-97ac9e3ac37a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'AV17HHF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=2674877',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO 1.2 TSI Match Edition 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.2 TSI Match Edition 5dr DSG',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:25 [manheim.gb] INFO: Saving data for 2674877: {'created_time': 1776863605.774857, 'last_price_update_time': 1776863605.774868}
2026-04-22 13:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-003.jpg> (referer: None)
2026-04-22 13:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_ext_7.jpg not downloaded yet
2026-04-22 13:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_3.jpg> (referer: None)
2026-04-22 13:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-002.jpg> (referer: None)
2026-04-22 13:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2dd3a50>
2026-04-22 13:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_5.jpg saved to cache
2026-04-22 13:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8b2a6fc-1aa4-54bb-b550-14f43495f653
2026-04-22 13:13:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8b2a6fc-1aa4-54bb-b550-14f43495f653, skipping ID generation
2026-04-22 13:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8b2a6fc-1aa4-54bb-b550-14f43495f653 with scrape type 1
2026-04-22 13:13:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8b2a6fc-1aa4-54bb-b550-14f43495f653 sending to next pipeline
2026-04-22 13:13:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b8b2a6fc-1aa4-54bb-b550-14f43495f653, identifier: 2549494
2026-04-22 13:13:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0efe1731-aee6-5214-a34a-dd51f8e0e5c0 with identifier: 2729093
2026-04-22 13:13:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0efe1731-aee6-5214-a34a-dd51f8e0e5c0 with scrape type 1
2026-04-22 13:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 0efe1731-aee6-5214-a34a-dd51f8e0e5c0
2026-04-22 13:13:26 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 0efe1731-aee6-5214-a34a-dd51f8e0e5c0
2026-04-22 13:13:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0efe1731-aee6-5214-a34a-dd51f8e0e5c0, identifier: 2729093
2026-04-22 13:13:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d39e384e-f27d-50a4-972b-3b4a532fd4aa with identifier: 2635347
2026-04-22 13:13:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d39e384e-f27d-50a4-972b-3b4a532fd4aa with scrape type 1
2026-04-22 13:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item d39e384e-f27d-50a4-972b-3b4a532fd4aa
2026-04-22 13:13:26 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item d39e384e-f27d-50a4-972b-3b4a532fd4aa
2026-04-22 13:13:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d39e384e-f27d-50a4-972b-3b4a532fd4aa, identifier: 2635347
2026-04-22 13:13:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44817855-8791-50eb-912d-77cbaf85f9ad with identifier: 2607333
2026-04-22 13:13:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44817855-8791-50eb-912d-77cbaf85f9ad with scrape type 1
2026-04-22 13:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 44817855-8791-50eb-912d-77cbaf85f9ad
2026-04-22 13:13:26 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 44817855-8791-50eb-912d-77cbaf85f9ad
2026-04-22 13:13:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 44817855-8791-50eb-912d-77cbaf85f9ad, identifier: 2607333
2026-04-22 13:13:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_4.jpg> (referer: None)
2026-04-22 13:13:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_4.jpg> (referer: None)
2026-04-22 13:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_ext_6.jpg not downloaded yet
2026-04-22 13:13:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b8b2a6fc-1aa4-54bb-b550-14f43495f653 with identifier: 2549494
2026-04-22 13:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:13:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Pink HTTP/1.1" 200 None
2026-04-22 13:13:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:13:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b8b2a6fc-1aa4-54bb-b550-14f43495f653 with identifier: 2549494
2026-04-22 13:13:26 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b8b2a6fc-1aa4-54bb-b550-14f43495f653 with identifier: 2549494 to the API
2026-04-22 13:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:26 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'Pink',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'b8b2a6fc-1aa4-54bb-b550-14f43495f653',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'EN17DUJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2549494',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 46572,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344147,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2549494-4168819-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240417,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268791,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299799,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314105,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218975,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198633,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175088,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186723,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8b2a6fc-1aa4-54bb-b550-14f43495f653/b8b2a6fc-1aa4-54bb-b550-14f43495f653_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208517,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cbdb3f64-dac3-40ff-8668-6781cb5f474c_4.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-06-24',
 'seller_name': None,
 'title': 'FIAT 500 1.2 Lounge 2dr',
 'transmission': 'manual',
 'trim': '1.2 Lounge 2dr',
 'year': 2017}
2026-04-22 13:13:26 [manheim.gb] INFO: Saving data for 2549494: {'created_time': 1776863606.857192, 'last_price_update_time': 1776863606.857207}
2026-04-22 13:13:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0efe1731-aee6-5214-a34a-dd51f8e0e5c0 with identifier: 2729093
2026-04-22 13:13:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0efe1731-aee6-5214-a34a-dd51f8e0e5c0 with identifier: 2729093
2026-04-22 13:13:26 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0efe1731-aee6-5214-a34a-dd51f8e0e5c0 with identifier: 2729093 to the API
2026-04-22 13:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'White',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '0efe1731-aee6-5214-a34a-dd51f8e0e5c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'VE18KRF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2729093',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 74921,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-06-26',
 'seller_name': None,
 'title': 'FIAT 500 1.2 Lounge 3dr',
 'transmission': 'manual',
 'trim': '1.2 Lounge 3dr',
 'year': 2018}
2026-04-22 13:13:27 [manheim.gb] INFO: Saving data for 2729093: {'created_time': 1776863607.226854, 'last_price_update_time': 1776863607.22687}
2026-04-22 13:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d39e384e-f27d-50a4-972b-3b4a532fd4aa with identifier: 2635347
2026-04-22 13:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:13:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FHybrid HTTP/1.1" 200 None
2026-04-22 13:13:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d39e384e-f27d-50a4-972b-3b4a532fd4aa with identifier: 2635347
2026-04-22 13:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: d39e384e-f27d-50a4-972b-3b4a532fd4aa with identifier: 2635347 to the API
2026-04-22 13:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:27 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id d39e384e-f27d-50a4-972b-3b4a532fd4aa: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:27 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:27 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:27 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol/Hybrid',
 'id': 'd39e384e-f27d-50a4-972b-3b4a532fd4aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'LM67UPW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/PASSAT?id=2635347',
 'listing': 'auction',
 'location': 'Manchester - In Transit',
 'longitude': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT 1.4 TSI GTE 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI GTE 5dr DSG',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:27 [manheim.gb] INFO: Saving data for 2635347: {'created_time': 1776863607.71532, 'last_price_update_time': 1776863607.715334}
2026-04-22 13:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 44817855-8791-50eb-912d-77cbaf85f9ad with identifier: 2607333
2026-04-22 13:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 44817855-8791-50eb-912d-77cbaf85f9ad with identifier: 2607333
2026-04-22 13:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 44817855-8791-50eb-912d-77cbaf85f9ad with identifier: 2607333 to the API
2026-04-22 13:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '44817855-8791-50eb-912d-77cbaf85f9ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'EU67NJZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/EDGE?id=2607333',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'FORD',
 'model': 'EDGE',
 'odometer': 57620,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-09-25',
 'seller_name': None,
 'title': 'FORD EDGE 2.0 TDCi 210 Sport 5dr Powershift',
 'transmission': 'automatic',
 'trim': '2.0 TDCi 210 Sport 5dr Powershift',
 'year': 2017}
2026-04-22 13:13:28 [manheim.gb] INFO: Saving data for 2607333: {'created_time': 1776863608.046687, 'last_price_update_time': 1776863608.046698}
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06d93d0>
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_11.jpg saved to cache
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09b5777a-f664-5418-a908-7af6ff28b467
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0622750>
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_4.jpg saved to cache
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09b5777a-f664-5418-a908-7af6ff28b467
2026-04-22 13:13:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09b5777a-f664-5418-a908-7af6ff28b467, skipping ID generation
2026-04-22 13:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09b5777a-f664-5418-a908-7af6ff28b467 with scrape type 1
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09b5777a-f664-5418-a908-7af6ff28b467 sending to next pipeline
2026-04-22 13:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 09b5777a-f664-5418-a908-7af6ff28b467, identifier: 2506745
2026-04-22 13:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_4.jpg> (referer: None)
2026-04-22 13:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 09b5777a-f664-5418-a908-7af6ff28b467 with identifier: 2506745
2026-04-22 13:13:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 09b5777a-f664-5418-a908-7af6ff28b467 with identifier: 2506745
2026-04-22 13:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 09b5777a-f664-5418-a908-7af6ff28b467 with identifier: 2506745 to the API
2026-04-22 13:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'White',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '09b5777a-f664-5418-a908-7af6ff28b467',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'LM67NGO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2506745',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 79559,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333014,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2506745-4170373-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186692,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186692,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271597,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189502,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161556,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144284,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159749,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142415,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09b5777a-f664-5418-a908-7af6ff28b467/09b5777a-f664-5418-a908-7af6ff28b467_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158026,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e2b049d-6f92-421e-9de9-6d6071e2255e_9.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-10-30',
 'seller_name': None,
 'title': 'FIAT 500 1.2 S 3dr',
 'transmission': 'manual',
 'trim': '1.2 S 3dr',
 'year': 2017}
2026-04-22 13:13:28 [manheim.gb] INFO: Saving data for 2506745: {'created_time': 1776863608.638825, 'last_price_update_time': 1776863608.638836}
2026-04-22 13:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_ext_1.jpg not downloaded yet
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0523a50>
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-003.jpg saved to cache
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b2d0a75-598d-5b7f-9167-3d4242b41250
2026-04-22 13:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb01577c-72ba-548e-8848-9270e6152cdf with identifier: 2604868
2026-04-22 13:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb01577c-72ba-548e-8848-9270e6152cdf with scrape type 1
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item eb01577c-72ba-548e-8848-9270e6152cdf
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item eb01577c-72ba-548e-8848-9270e6152cdf
2026-04-22 13:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: eb01577c-72ba-548e-8848-9270e6152cdf, identifier: 2604868
2026-04-22 13:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1564fc4b-2135-534f-b5e1-a0e201401db8 with identifier: 2697638
2026-04-22 13:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1564fc4b-2135-534f-b5e1-a0e201401db8 with scrape type 1
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1564fc4b-2135-534f-b5e1-a0e201401db8
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_ext_1.jpg not downloaded yet
2026-04-22 13:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9b5411c-ee9d-5461-80d0-11175c9fe85b with identifier: 2732998
2026-04-22 13:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9b5411c-ee9d-5461-80d0-11175c9fe85b with scrape type 1
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9b5411c-ee9d-5461-80d0-11175c9fe85b
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2732998-4169842-13.jpg not downloaded yet
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03d3790>
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_3.jpg saved to cache
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acb795cc-6134-5acf-8853-1847b70f3518
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b107f590>
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-002.jpg saved to cache
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b2d0a75-598d-5b7f-9167-3d4242b41250
2026-04-22 13:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55940e4d-4f9d-55b4-bd97-d581d185d22c with identifier: 2652779
2026-04-22 13:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55940e4d-4f9d-55b4-bd97-d581d185d22c with scrape type 1
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 55940e4d-4f9d-55b4-bd97-d581d185d22c
2026-04-22 13:13:28 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 55940e4d-4f9d-55b4-bd97-d581d185d22c
2026-04-22 13:13:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 55940e4d-4f9d-55b4-bd97-d581d185d22c, identifier: 2652779
2026-04-22 13:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: eb01577c-72ba-548e-8848-9270e6152cdf with identifier: 2604868
2026-04-22 13:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: eb01577c-72ba-548e-8848-9270e6152cdf with identifier: 2604868
2026-04-22 13:13:29 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: eb01577c-72ba-548e-8848-9270e6152cdf with identifier: 2604868 to the API
2026-04-22 13:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:29 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id eb01577c-72ba-548e-8848-9270e6152cdf: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:28 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:29 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:29 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Haydock - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'eb01577c-72ba-548e-8848-9270e6152cdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DU16DLJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2604868',
 'listing': 'auction',
 'location': 'Haydock - In Transit',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-03-31',
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.6 dCi N-Connecta 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.6 dCi N-Connecta 5dr Xtronic',
 'year': 2016}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:29 [manheim.gb] INFO: Saving data for 2604868: {'created_time': 1776863609.362157, 'last_price_update_time': 1776863609.362168}
2026-04-22 13:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 55940e4d-4f9d-55b4-bd97-d581d185d22c with identifier: 2652779
2026-04-22 13:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 55940e4d-4f9d-55b4-bd97-d581d185d22c with identifier: 2652779
2026-04-22 13:13:29 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 55940e4d-4f9d-55b4-bd97-d581d185d22c with identifier: 2652779 to the API
2026-04-22 13:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '55940e4d-4f9d-55b4-bd97-d581d185d22c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YE69FZD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/DS/DS%203?id=2652779',
 'listing': 'auction',
 'location': 'Washington',
 'longitude': None,
 'make': 'DS',
 'model': 'DS 3',
 'odometer': 51157,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'DS DS 3 1.2 PureTech Prestige 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Prestige 5dr',
 'year': 2019}
2026-04-22 13:13:29 [manheim.gb] INFO: Saving data for 2652779: {'created_time': 1776863609.694717, 'last_price_update_time': 1776863609.694729}
2026-04-22 13:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_ext_7.jpg> (referer: None)
2026-04-22 13:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_9.jpg> (referer: None)
2026-04-22 13:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_9.jpg> (referer: None)
2026-04-22 13:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_5.jpg not downloaded yet
2026-04-22 13:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_ext_7.jpg not downloaded yet
2026-04-22 13:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_ext_7.jpg not downloaded yet
2026-04-22 13:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05d40d0>
2026-04-22 13:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_4.jpg saved to cache
2026-04-22 13:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89b1fe7c-fb09-55af-8748-15437187203c
2026-04-22 13:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05e32d0>
2026-04-22 13:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_4.jpg saved to cache
2026-04-22 13:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733
2026-04-22 13:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fb0fd0>
2026-04-22 13:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_4.jpg saved to cache
2026-04-22 13:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acb795cc-6134-5acf-8853-1847b70f3518
2026-04-22 13:13:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acb795cc-6134-5acf-8853-1847b70f3518, skipping ID generation
2026-04-22 13:13:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb795cc-6134-5acf-8853-1847b70f3518 with scrape type 1
2026-04-22 13:13:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acb795cc-6134-5acf-8853-1847b70f3518 sending to next pipeline
2026-04-22 13:13:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: acb795cc-6134-5acf-8853-1847b70f3518, identifier: 2545463
2026-04-22 13:13:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fee29734-5ccc-537f-8c5b-153a6d1d0ad9 with identifier: 2591496
2026-04-22 13:13:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fee29734-5ccc-537f-8c5b-153a6d1d0ad9 with scrape type 1
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fee29734-5ccc-537f-8c5b-153a6d1d0ad9
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_7.jpg not downloaded yet
2026-04-22 13:13:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da610c7-a81d-5f21-81c5-7b68ce46fb14 with identifier: 2733207
2026-04-22 13:13:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da610c7-a81d-5f21-81c5-7b68ce46fb14 with scrape type 1
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6da610c7-a81d-5f21-81c5-7b68ce46fb14
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_7.jpg not downloaded yet
2026-04-22 13:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-005.jpg> (referer: None)
2026-04-22 13:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2475613-4164462-13.jpg> (referer: None)
2026-04-22 13:13:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: acb795cc-6134-5acf-8853-1847b70f3518 with identifier: 2545463
2026-04-22 13:13:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: acb795cc-6134-5acf-8853-1847b70f3518 with identifier: 2545463
2026-04-22 13:13:30 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: acb795cc-6134-5acf-8853-1847b70f3518 with identifier: 2545463 to the API
2026-04-22 13:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:30 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id acb795cc-6134-5acf-8853-1847b70f3518: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:29 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:30 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:30 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Northampton - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'acb795cc-6134-5acf-8853-1847b70f3518',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'FJ18WYW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/VIVARO?id=2545463',
 'listing': 'auction',
 'location': 'Northampton - In Transit',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'VIVARO',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332816,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2545463-2792567-13.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208767,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222278,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313665,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213519,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260326,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209593,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186273,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205779,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb795cc-6134-5acf-8853-1847b70f3518/acb795cc-6134-5acf-8853-1847b70f3518_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202013,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a79e5b35-2691-41c8-becc-bcf5a457b4ea_4.jpg',
             'Width': 1500}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-03-28',
 'seller_name': None,
 'title': 'VAUXHALL VIVARO 2700 1.6CDTI BiTurbo 125PS Sportive H1 Van',
 'transmission': 'manual',
 'trim': '2700 1.6CDTI BiTurbo 125PS Sportive H1 Van',
 'year': 2018}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:30 [manheim.gb] INFO: Saving data for 2545463: {'created_time': 1776863610.427729, 'last_price_update_time': 1776863610.427741}
2026-04-22 13:13:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f594edbc-037c-5307-87ff-7cb1a723c9a0 with identifier: 2733084
2026-04-22 13:13:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f594edbc-037c-5307-87ff-7cb1a723c9a0 with scrape type 1
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f594edbc-037c-5307-87ff-7cb1a723c9a0
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_ext_7.jpg not downloaded yet
2026-04-22 13:13:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6d780d4-493f-55b8-bc74-374b220b8931 with identifier: 2596287
2026-04-22 13:13:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6d780d4-493f-55b8-bc74-374b220b8931 with scrape type 1
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f6d780d4-493f-55b8-bc74-374b220b8931
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f6d780d4-493f-55b8-bc74-374b220b8931
2026-04-22 13:13:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f6d780d4-493f-55b8-bc74-374b220b8931, identifier: 2596287
2026-04-22 13:13:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 929056f3-6de8-5062-b4dd-b202fd222e9f with identifier: 2585727
2026-04-22 13:13:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 929056f3-6de8-5062-b4dd-b202fd222e9f with scrape type 2
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 929056f3-6de8-5062-b4dd-b202fd222e9f with scrape type 2
2026-04-22 13:13:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 929056f3-6de8-5062-b4dd-b202fd222e9f, identifier: 2585727
2026-04-22 13:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_ext_7.jpg> (referer: None)
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_4.jpg not downloaded yet
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_5.jpg not downloaded yet
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_ext_7.jpg not downloaded yet
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_7.jpg not downloaded yet
2026-04-22 13:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_7.jpg not downloaded yet
2026-04-22 13:13:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f6d780d4-493f-55b8-bc74-374b220b8931 with identifier: 2596287
2026-04-22 13:13:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f6d780d4-493f-55b8-bc74-374b220b8931 with identifier: 2596287
2026-04-22 13:13:30 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f6d780d4-493f-55b8-bc74-374b220b8931 with identifier: 2596287 to the API
2026-04-22 13:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:31 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id f6d780d4-493f-55b8-bc74-374b220b8931: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:30 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:31 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:31 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'f6d780d4-493f-55b8-bc74-374b220b8931',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'PF67WBY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/JEEP/GRAND%20CHEROKEE?id=2596287',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'JEEP',
 'model': 'GRAND CHEROKEE',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-01-31',
 'seller_name': None,
 'title': 'JEEP GRAND CHEROKEE 3.0 CRD Trailhawk 5dr Auto',
 'transmission': 'automatic',
 'trim': '3.0 CRD Trailhawk 5dr Auto',
 'year': 2018}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:31 [manheim.gb] INFO: Saving data for 2596287: {'created_time': 1776863611.482381, 'last_price_update_time': 1776863611.482411}
2026-04-22 13:13:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 929056f3-6de8-5062-b4dd-b202fd222e9f with identifier: 2585727
2026-04-22 13:13:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 929056f3-6de8-5062-b4dd-b202fd222e9f with identifier: 2585727
2026-04-22 13:13:31 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 929056f3-6de8-5062-b4dd-b202fd222e9f with identifier: 2585727 to the API
2026-04-22 13:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '929056f3-6de8-5062-b4dd-b202fd222e9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'EX68TTV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=2585727',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': 78585,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-09-18',
 'seller_name': None,
 'title': 'MERCEDES-BENZ A CLASS A180d AMG Line Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A180d AMG Line Premium 5dr Auto',
 'year': 2018}
2026-04-22 13:13:31 [manheim.gb] INFO: Saving data for 2585727: {'created_time': 1776247804.119588, 'last_price_update_time': 1776863611.888084}
2026-04-22 13:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_ext_7.jpg not downloaded yet
2026-04-22 13:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06836d0>
2026-04-22 13:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd401410-ff54-5874-a6e1-9c297f8bedf7/fd401410-ff54-5874-a6e1-9c297f8bedf7_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_ext_7.jpg saved to cache
2026-04-22 13:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd401410-ff54-5874-a6e1-9c297f8bedf7
2026-04-22 13:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0649210>
2026-04-22 13:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_9.jpg saved to cache
2026-04-22 13:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89b1fe7c-fb09-55af-8748-15437187203c
2026-04-22 13:13:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89b1fe7c-fb09-55af-8748-15437187203c, skipping ID generation
2026-04-22 13:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89b1fe7c-fb09-55af-8748-15437187203c with scrape type 1
2026-04-22 13:13:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89b1fe7c-fb09-55af-8748-15437187203c sending to next pipeline
2026-04-22 13:13:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 89b1fe7c-fb09-55af-8748-15437187203c, identifier: 2472180
2026-04-22 13:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1616c10>
2026-04-22 13:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_9.jpg saved to cache
2026-04-22 13:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733
2026-04-22 13:13:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 417e2b61-1a79-5e32-8b2a-37c3fd9b5733, skipping ID generation
2026-04-22 13:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733 with scrape type 1
2026-04-22 13:13:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 417e2b61-1a79-5e32-8b2a-37c3fd9b5733 sending to next pipeline
2026-04-22 13:13:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 417e2b61-1a79-5e32-8b2a-37c3fd9b5733, identifier: 2466891
2026-04-22 13:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_11.jpg not downloaded yet
2026-04-22 13:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_4.jpg not downloaded yet
2026-04-22 13:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_ext_6.jpg not downloaded yet
2026-04-22 13:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_6.jpg not downloaded yet
2026-04-22 13:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_6.jpg not downloaded yet
2026-04-22 13:13:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 89b1fe7c-fb09-55af-8748-15437187203c with identifier: 2472180
2026-04-22 13:13:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 89b1fe7c-fb09-55af-8748-15437187203c with identifier: 2472180
2026-04-22 13:13:32 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 89b1fe7c-fb09-55af-8748-15437187203c with identifier: 2472180 to the API
2026-04-22 13:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:32 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '89b1fe7c-fb09-55af-8748-15437187203c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'RK17CDY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/INFINITI/Q30?id=2472180',
 'listing': 'auction',
 'location': 'Manchester',
 'longitude': None,
 'make': 'INFINITI',
 'model': 'Q30',
 'odometer': 115564,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354273,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2472180-4136241-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195935,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220880,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236553,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230827,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274457,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195190,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184820,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199216,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89b1fe7c-fb09-55af-8748-15437187203c/89b1fe7c-fb09-55af-8748-15437187203c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191828,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c50b8a39-a98f-43d9-85a5-d5eb481bdbd9_4.jpg',
             'Width': 1500}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-06-30',
 'seller_name': None,
 'title': 'INFINITI Q30 1.5d SE 5dr',
 'transmission': 'manual',
 'trim': '1.5d SE 5dr',
 'year': 2017}
2026-04-22 13:13:32 [manheim.gb] INFO: Saving data for 2472180: {'created_time': 1776863612.777585, 'last_price_update_time': 1776863612.777603}
2026-04-22 13:13:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 417e2b61-1a79-5e32-8b2a-37c3fd9b5733 with identifier: 2466891
2026-04-22 13:13:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 417e2b61-1a79-5e32-8b2a-37c3fd9b5733 with identifier: 2466891
2026-04-22 13:13:32 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 417e2b61-1a79-5e32-8b2a-37c3fd9b5733 with identifier: 2466891 to the API
2026-04-22 13:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:33 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.1L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '417e2b61-1a79-5e32-8b2a-37c3fd9b5733',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'LS18CNY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CLA%20CLASS?id=2466891',
 'listing': 'auction',
 'location': 'Manchester',
 'longitude': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA CLASS',
 'odometer': 69698,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334698,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2466891-4167303-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192458,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245076,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226695,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224122,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270598,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185131,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183590,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196680,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_417e2b61-1a79-5e32-8b2a-37c3fd9b5733/417e2b61-1a79-5e32-8b2a-37c3fd9b5733_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188765,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/28020538-9f5e-4aff-883b-63a441282c65_4.jpg',
             'Width': 1500}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-04-27',
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLASS GLC 220d 4Matic AMG Line Premium 5dr '
          '9G-Tronic',
 'transmission': 'automatic',
 'trim': 'GLC 220d 4Matic AMG Line Premium 5dr 9G-Tronic',
 'year': 2018}
2026-04-22 13:13:33 [manheim.gb] INFO: Saving data for 2466891: {'created_time': 1776863613.209739, 'last_price_update_time': 1776863613.209749}
2026-04-22 13:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_ext_6.jpg> (referer: None)
2026-04-22 13:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_ext_1.jpg> (referer: None)
2026-04-22 13:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_ext_1.jpg> (referer: None)
2026-04-22 13:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_ext_6.jpg not downloaded yet
2026-04-22 13:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fd8950>
2026-04-22 13:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-005.jpg saved to cache
2026-04-22 13:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b2d0a75-598d-5b7f-9167-3d4242b41250
2026-04-22 13:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b104a7d0>
2026-04-22 13:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2475613-4164462-13.jpg saved to cache
2026-04-22 13:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b2d0a75-598d-5b7f-9167-3d4242b41250
2026-04-22 13:13:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b2d0a75-598d-5b7f-9167-3d4242b41250, skipping ID generation
2026-04-22 13:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b2d0a75-598d-5b7f-9167-3d4242b41250 with scrape type 1
2026-04-22 13:13:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b2d0a75-598d-5b7f-9167-3d4242b41250 sending to next pipeline
2026-04-22 13:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4b2d0a75-598d-5b7f-9167-3d4242b41250, identifier: 2475613
2026-04-22 13:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04f6a90>
2026-04-22 13:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd401410-ff54-5874-a6e1-9c297f8bedf7/fd401410-ff54-5874-a6e1-9c297f8bedf7_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_ext_7.jpg saved to cache
2026-04-22 13:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd401410-ff54-5874-a6e1-9c297f8bedf7
2026-04-22 13:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_10.jpg not downloaded yet
2026-04-22 13:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_11.jpg not downloaded yet
2026-04-22 13:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_ext_1.jpg not downloaded yet
2026-04-22 13:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_1.jpg not downloaded yet
2026-04-22 13:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_1.jpg not downloaded yet
2026-04-22 13:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4b2d0a75-598d-5b7f-9167-3d4242b41250 with identifier: 2475613
2026-04-22 13:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4b2d0a75-598d-5b7f-9167-3d4242b41250 with identifier: 2475613
2026-04-22 13:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 4b2d0a75-598d-5b7f-9167-3d4242b41250 with identifier: 2475613 to the API
2026-04-22 13:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-2475613-4164462-13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Washington',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '4b2d0a75-598d-5b7f-9167-3d4242b41250',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'SD66OOG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=2475613',
 'listing': 'auction',
 'location': 'Washington',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 76189,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257175,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291853,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230450,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230806,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265979,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319003,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2475613-4164462-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256996,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292378,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251601,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2d0a75-598d-5b7f-9167-3d4242b41250/4b2d0a75-598d-5b7f-9167-3d4242b41250_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267090,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2475613-9999999-107131732-002.jpg',
             'Width': 1333}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2016-09-30',
 'seller_name': None,
 'title': 'PEUGEOT 208 1.0 PureTech Active 5dr',
 'transmission': 'manual',
 'trim': '1.0 PureTech Active 5dr',
 'year': 2016}
2026-04-22 13:13:34 [manheim.gb] INFO: Saving data for 2475613: {'created_time': 1776863614.025315, 'last_price_update_time': 1776863614.025325}
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_ext_1.jpg not downloaded yet
2026-04-22 13:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2732998-4169842-13.jpg> (referer: None)
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_9.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_10.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_5.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_5.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_5.jpg not downloaded yet
2026-04-22 13:13:34 [manheim.gb] INFO: Page 5: 100 results (total: 14785)
2026-04-22 13:13:34 [manheim.gb] INFO: Found listing with ID: 2746587
2026-04-22 13:13:34 [manheim.gb] INFO: Scrape type for 2746587: 0
2026-04-22 13:13:34 [manheim.gb] INFO: Found listing with ID: 2760387
2026-04-22 13:13:34 [manheim.gb] INFO: Scrape type for 2760387: 0
2026-04-22 13:13:34 [manheim.gb] INFO: Found listing with ID: 2765887
2026-04-22 13:13:34 [manheim.gb] INFO: Scrape type for 2765887: 0
2026-04-22 13:13:34 [manheim.gb] INFO: Found listing with ID: 2766058
2026-04-22 13:13:34 [manheim.gb] INFO: Scrape type for 2766058: 1
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03c0150>
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd401410-ff54-5874-a6e1-9c297f8bedf7/fd401410-ff54-5874-a6e1-9c297f8bedf7_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_ext_6.jpg saved to cache
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd401410-ff54-5874-a6e1-9c297f8bedf7
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b107fa90>
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1564fc4b-2135-534f-b5e1-a0e201401db8/1564fc4b-2135-534f-b5e1-a0e201401db8_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_ext_1.jpg saved to cache
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1564fc4b-2135-534f-b5e1-a0e201401db8
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05624d0>
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd401410-ff54-5874-a6e1-9c297f8bedf7/fd401410-ff54-5874-a6e1-9c297f8bedf7_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_ext_1.jpg saved to cache
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd401410-ff54-5874-a6e1-9c297f8bedf7
2026-04-22 13:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_7.jpg> (referer: None)
2026-04-22 13:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_ext_7.jpg> (referer: None)
2026-04-22 13:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_7.jpg> (referer: None)
2026-04-22 13:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_ext_7.jpg> (referer: None)
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_5.jpg not downloaded yet
2026-04-22 13:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_ext_7.jpg> (referer: None)
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_ext_2.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_9.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_4.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_4.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_4.jpg not downloaded yet
2026-04-22 13:13:34 [manheim.gb] INFO: Found listing with ID: 2771601
2026-04-22 13:13:34 [manheim.gb] INFO: Scrape type for 2771601: 1
2026-04-22 13:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_7.jpg> (referer: None)
2026-04-22 13:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_5.jpg> (referer: None)
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_4.jpg not downloaded yet
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03e24d0>
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9b5411c-ee9d-5461-80d0-11175c9fe85b/e9b5411c-ee9d-5461-80d0-11175c9fe85b_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2732998-4169842-13.jpg saved to cache
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9b5411c-ee9d-5461-80d0-11175c9fe85b
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_ext_2.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_11.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_11.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_11.jpg not downloaded yet
2026-04-22 13:13:34 [manheim.gb] INFO: Found listing with ID: 2775467
2026-04-22 13:13:34 [manheim.gb] INFO: Scrape type for 2775467: 0
2026-04-22 13:13:34 [manheim.gb] INFO: Found listing with ID: 2776393
2026-04-22 13:13:34 [manheim.gb] INFO: Scrape type for 2776393: 0
2026-04-22 13:13:34 [manheim.gb] INFO: Found listing with ID: 2777429
2026-04-22 13:13:34 [manheim.gb] INFO: Scrape type for 2777429: 1
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_11.jpg not downloaded yet
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b161a990>
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee29734-5ccc-537f-8c5b-153a6d1d0ad9/fee29734-5ccc-537f-8c5b-153a6d1d0ad9_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_7.jpg saved to cache
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fee29734-5ccc-537f-8c5b-153a6d1d0ad9
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fb4f90>
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9b5411c-ee9d-5461-80d0-11175c9fe85b/e9b5411c-ee9d-5461-80d0-11175c9fe85b_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_ext_7.jpg saved to cache
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9b5411c-ee9d-5461-80d0-11175c9fe85b
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0546b50>
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da610c7-a81d-5f21-81c5-7b68ce46fb14/6da610c7-a81d-5f21-81c5-7b68ce46fb14_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_7.jpg saved to cache
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6da610c7-a81d-5f21-81c5-7b68ce46fb14
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b186f7d0>
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594edbc-037c-5307-87ff-7cb1a723c9a0/f594edbc-037c-5307-87ff-7cb1a723c9a0_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_ext_7.jpg saved to cache
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f594edbc-037c-5307-87ff-7cb1a723c9a0
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0ff6b50>
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1564fc4b-2135-534f-b5e1-a0e201401db8/1564fc4b-2135-534f-b5e1-a0e201401db8_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_ext_7.jpg saved to cache
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1564fc4b-2135-534f-b5e1-a0e201401db8
2026-04-22 13:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2697638-4170173-13.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_10.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_10.jpg not downloaded yet
2026-04-22 13:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_10.jpg not downloaded yet
2026-04-22 13:13:34 [manheim.gb] INFO: Found listing with ID: 2778346
2026-04-22 13:13:35 [manheim.gb] INFO: Scrape type for 2778346: 1
2026-04-22 13:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_7.jpg> (referer: None)
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_10.jpg not downloaded yet
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1728590>
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da610c7-a81d-5f21-81c5-7b68ce46fb14/6da610c7-a81d-5f21-81c5-7b68ce46fb14_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_7.jpg saved to cache
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6da610c7-a81d-5f21-81c5-7b68ce46fb14
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1749510>
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd401410-ff54-5874-a6e1-9c297f8bedf7/fd401410-ff54-5874-a6e1-9c297f8bedf7_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_5.jpg saved to cache
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd401410-ff54-5874-a6e1-9c297f8bedf7
2026-04-22 13:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_ext_7.jpg> (referer: None)
2026-04-22 13:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_ext_7.jpg> (referer: None)
2026-04-22 13:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_5.jpg> (referer: None)
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_ext_4.jpg not downloaded yet
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_9.jpg not downloaded yet
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_9.jpg not downloaded yet
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_9.jpg not downloaded yet
2026-04-22 13:13:35 [manheim.gb] INFO: Found listing with ID: 2779280
2026-04-22 13:13:35 [manheim.gb] INFO: Scrape type for 2779280: 0
2026-04-22 13:13:35 [manheim.gb] INFO: Found listing with ID: 2780201
2026-04-22 13:13:35 [manheim.gb] INFO: Scrape type for 2780201: 0
2026-04-22 13:13:35 [manheim.gb] INFO: Found listing with ID: 2782604
2026-04-22 13:13:35 [manheim.gb] INFO: Scrape type for 2782604: 0
2026-04-22 13:13:35 [manheim.gb] INFO: Found listing with ID: 2782935
2026-04-22 13:13:35 [manheim.gb] INFO: Scrape type for 2782935: 1
2026-04-22 13:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_4.jpg> (referer: None)
2026-04-22 13:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_6.jpg> (referer: None)
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_9.jpg not downloaded yet
2026-04-22 13:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_6.jpg> (referer: None)
2026-04-22 13:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_2.jpg not downloaded yet
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_2.jpg not downloaded yet
2026-04-22 13:13:35 [manheim.gb] INFO: Found listing with ID: 2784702
2026-04-22 13:13:35 [manheim.gb] INFO: Scrape type for 2784702: 0
2026-04-22 13:13:35 [manheim.gb] INFO: Found listing with ID: 2786149
2026-04-22 13:13:35 [manheim.gb] INFO: Scrape type for 2786149: 0
2026-04-22 13:13:35 [manheim.gb] INFO: Found listing with ID: 2788927
2026-04-22 13:13:35 [manheim.gb] INFO: Scrape type for 2788927: 1
2026-04-22 13:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cae527d-2d16-575c-ae7a-57f30d2ee322 with identifier: 2766058
2026-04-22 13:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cae527d-2d16-575c-ae7a-57f30d2ee322 with scrape type 1
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 1cae527d-2d16-575c-ae7a-57f30d2ee322
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-28.jpg not downloaded yet
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1663cd0>
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee29734-5ccc-537f-8c5b-153a6d1d0ad9/fee29734-5ccc-537f-8c5b-153a6d1d0ad9_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_7.jpg saved to cache
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fee29734-5ccc-537f-8c5b-153a6d1d0ad9
2026-04-22 13:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_ext_6.jpg> (referer: None)
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_ext_2.jpg not downloaded yet
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b10219d0>
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594edbc-037c-5307-87ff-7cb1a723c9a0/f594edbc-037c-5307-87ff-7cb1a723c9a0_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_ext_7.jpg saved to cache
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f594edbc-037c-5307-87ff-7cb1a723c9a0
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0ff53d0>
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9b5411c-ee9d-5461-80d0-11175c9fe85b/e9b5411c-ee9d-5461-80d0-11175c9fe85b_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_ext_7.jpg saved to cache
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9b5411c-ee9d-5461-80d0-11175c9fe85b
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0616590>
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1564fc4b-2135-534f-b5e1-a0e201401db8/1564fc4b-2135-534f-b5e1-a0e201401db8_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_5.jpg saved to cache
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1564fc4b-2135-534f-b5e1-a0e201401db8
2026-04-22 13:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:35 [manheim.gb] INFO: Found listing with ID: 2793799
2026-04-22 13:13:35 [manheim.gb] INFO: Scrape type for 2793799: 0
2026-04-22 13:13:35 [manheim.gb] INFO: Found listing with ID: 2800186
2026-04-22 13:13:35 [manheim.gb] INFO: Scrape type for 2800186: 1
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-16.jpg not downloaded yet
2026-04-22 13:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_1.jpg> (referer: None)
2026-04-22 13:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_1.jpg> (referer: None)
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b075a7d0>
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd401410-ff54-5874-a6e1-9c297f8bedf7/fd401410-ff54-5874-a6e1-9c297f8bedf7_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f8b2b46e-af9f-4014-aff7-a8ca0b29fc33_4.jpg saved to cache
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd401410-ff54-5874-a6e1-9c297f8bedf7
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03ae250>
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da610c7-a81d-5f21-81c5-7b68ce46fb14/6da610c7-a81d-5f21-81c5-7b68ce46fb14_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_6.jpg saved to cache
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6da610c7-a81d-5f21-81c5-7b68ce46fb14
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0771b90>
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee29734-5ccc-537f-8c5b-153a6d1d0ad9/fee29734-5ccc-537f-8c5b-153a6d1d0ad9_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_6.jpg saved to cache
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fee29734-5ccc-537f-8c5b-153a6d1d0ad9
2026-04-22 13:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cd6cca8-ea77-5ec5-a983-1b591285b92e with identifier: 2777429
2026-04-22 13:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cd6cca8-ea77-5ec5-a983-1b591285b92e with scrape type 1
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2cd6cca8-ea77-5ec5-a983-1b591285b92e
2026-04-22 13:13:35 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2cd6cca8-ea77-5ec5-a983-1b591285b92e
2026-04-22 13:13:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2cd6cca8-ea77-5ec5-a983-1b591285b92e, identifier: 2777429
2026-04-22 13:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_ext_1.jpg> (referer: None)
2026-04-22 13:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_ext_1.jpg> (referer: None)
2026-04-22 13:13:36 [manheim.gb] INFO: Found listing with ID: 2800451
2026-04-22 13:13:36 [manheim.gb] INFO: Scrape type for 2800451: 1
2026-04-22 13:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-13.jpg not downloaded yet
2026-04-22 13:13:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2cd6cca8-ea77-5ec5-a983-1b591285b92e with identifier: 2777429
2026-04-22 13:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2cd6cca8-ea77-5ec5-a983-1b591285b92e with identifier: 2777429
2026-04-22 13:13:36 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 2cd6cca8-ea77-5ec5-a983-1b591285b92e with identifier: 2777429 to the API
2026-04-22 13:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:36 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 2cd6cca8-ea77-5ec5-a983-1b591285b92e: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:36 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:36 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:36 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '2cd6cca8-ea77-5ec5-a983-1b591285b92e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YC12PHF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/FABIA?id=2777429',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'SKODA',
 'model': 'FABIA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2012-05-22',
 'seller_name': None,
 'title': 'SKODA FABIA 1.2 12V SE 5dr',
 'transmission': 'manual',
 'trim': '1.2 12V SE 5dr',
 'year': 2012}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:36 [manheim.gb] INFO: Saving data for 2777429: {'created_time': 1776863616.501968, 'last_price_update_time': 1776863616.501986}
2026-04-22 13:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_11.jpg> (referer: None)
2026-04-22 13:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16144d0>
2026-04-22 13:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9b5411c-ee9d-5461-80d0-11175c9fe85b/e9b5411c-ee9d-5461-80d0-11175c9fe85b_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_ext_6.jpg saved to cache
2026-04-22 13:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9b5411c-ee9d-5461-80d0-11175c9fe85b
2026-04-22 13:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_5.jpg> (referer: None)
2026-04-22 13:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_5.jpg> (referer: None)
2026-04-22 13:13:36 [manheim.gb] INFO: Found listing with ID: 2811920
2026-04-22 13:13:36 [manheim.gb] INFO: Scrape type for 2811920: 0
2026-04-22 13:13:36 [manheim.gb] INFO: Found listing with ID: 2812160
2026-04-22 13:13:36 [manheim.gb] INFO: Scrape type for 2812160: 1
2026-04-22 13:13:36 [manheim.gb] ERROR: Error extracting listing 2812160: Field transmission is not nullable
2026-04-22 13:13:36 [manheim.gb] INFO: Found listing with ID: 2812219
2026-04-22 13:13:36 [manheim.gb] INFO: Scrape type for 2812219: 1
2026-04-22 13:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-8.jpg not downloaded yet
2026-04-22 13:13:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2127a40-a951-5ced-a101-2741858f59a7 with identifier: 2778346
2026-04-22 13:13:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2127a40-a951-5ced-a101-2741858f59a7 with scrape type 1
2026-04-22 13:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a2127a40-a951-5ced-a101-2741858f59a7
2026-04-22 13:13:36 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a2127a40-a951-5ced-a101-2741858f59a7
2026-04-22 13:13:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a2127a40-a951-5ced-a101-2741858f59a7, identifier: 2778346
2026-04-22 13:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1096710>
2026-04-22 13:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da610c7-a81d-5f21-81c5-7b68ce46fb14/6da610c7-a81d-5f21-81c5-7b68ce46fb14_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_1.jpg saved to cache
2026-04-22 13:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6da610c7-a81d-5f21-81c5-7b68ce46fb14
2026-04-22 13:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b07465d0>
2026-04-22 13:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee29734-5ccc-537f-8c5b-153a6d1d0ad9/fee29734-5ccc-537f-8c5b-153a6d1d0ad9_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_1.jpg saved to cache
2026-04-22 13:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fee29734-5ccc-537f-8c5b-153a6d1d0ad9
2026-04-22 13:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a2127a40-a951-5ced-a101-2741858f59a7 with identifier: 2778346
2026-04-22 13:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a2127a40-a951-5ced-a101-2741858f59a7 with identifier: 2778346
2026-04-22 13:13:37 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a2127a40-a951-5ced-a101-2741858f59a7 with identifier: 2778346 to the API
2026-04-22 13:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:37 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id a2127a40-a951-5ced-a101-2741858f59a7: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:36 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:37 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:37 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'a2127a40-a951-5ced-a101-2741858f59a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DV17ZTP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=2778346',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'ASTRA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2017-03-31',
 'seller_name': None,
 'title': 'VAUXHALL ASTRA 1.0T 12V ecoFLEX Design 5dr',
 'transmission': 'manual',
 'trim': '1.0T 12V ecoFLEX Design 5dr',
 'year': 2017}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:37 [manheim.gb] INFO: Saving data for 2778346: {'created_time': 1776863617.28225, 'last_price_update_time': 1776863617.282268}
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03cb6d0>
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9b5411c-ee9d-5461-80d0-11175c9fe85b/e9b5411c-ee9d-5461-80d0-11175c9fe85b_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_ext_1.jpg saved to cache
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9b5411c-ee9d-5461-80d0-11175c9fe85b
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b062fc10>
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594edbc-037c-5307-87ff-7cb1a723c9a0/f594edbc-037c-5307-87ff-7cb1a723c9a0_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_ext_1.jpg saved to cache
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f594edbc-037c-5307-87ff-7cb1a723c9a0
2026-04-22 13:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_11.jpg> (referer: None)
2026-04-22 13:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:37 [manheim.gb] INFO: Found listing with ID: 2812751
2026-04-22 13:13:37 [manheim.gb] INFO: Scrape type for 2812751: 0
2026-04-22 13:13:37 [manheim.gb] INFO: Found listing with ID: 2814136
2026-04-22 13:13:37 [manheim.gb] INFO: Scrape type for 2814136: 0
2026-04-22 13:13:37 [manheim.gb] INFO: Found listing with ID: 2815577
2026-04-22 13:13:37 [manheim.gb] INFO: Scrape type for 2815577: 1
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-6.jpg not downloaded yet
2026-04-22 13:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_10.jpg> (referer: None)
2026-04-22 13:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_10.jpg> (referer: None)
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0ff0110>
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1564fc4b-2135-534f-b5e1-a0e201401db8/1564fc4b-2135-534f-b5e1-a0e201401db8_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_11.jpg saved to cache
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1564fc4b-2135-534f-b5e1-a0e201401db8
2026-04-22 13:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22378020-615b-5fe9-8922-82281bc1ea3b with identifier: 2782935
2026-04-22 13:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22378020-615b-5fe9-8922-82281bc1ea3b with scrape type 1
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 22378020-615b-5fe9-8922-82281bc1ea3b
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2782935-4004071-8.jpg not downloaded yet
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03c9e50>
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594edbc-037c-5307-87ff-7cb1a723c9a0/f594edbc-037c-5307-87ff-7cb1a723c9a0_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_5.jpg saved to cache
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f594edbc-037c-5307-87ff-7cb1a723c9a0
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1633ed0>
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da610c7-a81d-5f21-81c5-7b68ce46fb14/6da610c7-a81d-5f21-81c5-7b68ce46fb14_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_5.jpg saved to cache
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6da610c7-a81d-5f21-81c5-7b68ce46fb14
2026-04-22 13:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:37 [manheim.gb] INFO: Found listing with ID: 2817028
2026-04-22 13:13:37 [manheim.gb] INFO: Scrape type for 2817028: 0
2026-04-22 13:13:37 [manheim.gb] INFO: Found listing with ID: 281703
2026-04-22 13:13:37 [manheim.gb] INFO: Scrape type for 281703: 0
2026-04-22 13:13:37 [manheim.gb] INFO: Found listing with ID: 2818070
2026-04-22 13:13:37 [manheim.gb] INFO: Scrape type for 2818070: 1
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-4.jpg not downloaded yet
2026-04-22 13:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_10.jpg> (referer: None)
2026-04-22 13:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_10.jpg> (referer: None)
2026-04-22 13:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_9.jpg> (referer: None)
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2782935-4004071-13.jpg not downloaded yet
2026-04-22 13:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c224db37-f7a0-5b84-8d44-d6a796c68acd with identifier: 2788927
2026-04-22 13:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c224db37-f7a0-5b84-8d44-d6a796c68acd with scrape type 1
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item c224db37-f7a0-5b84-8d44-d6a796c68acd
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item c224db37-f7a0-5b84-8d44-d6a796c68acd
2026-04-22 13:13:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c224db37-f7a0-5b84-8d44-d6a796c68acd, identifier: 2788927
2026-04-22 13:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_ext_2.jpg> (referer: None)
2026-04-22 13:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_9.jpg> (referer: None)
2026-04-22 13:13:37 [manheim.gb] INFO: Found listing with ID: 2818919
2026-04-22 13:13:37 [manheim.gb] INFO: Scrape type for 2818919: 0
2026-04-22 13:13:37 [manheim.gb] INFO: Found listing with ID: 2823142
2026-04-22 13:13:37 [manheim.gb] INFO: Scrape type for 2823142: 0
2026-04-22 13:13:37 [manheim.gb] INFO: Found listing with ID: 2827205
2026-04-22 13:13:37 [manheim.gb] INFO: Scrape type for 2827205: 1
2026-04-22 13:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-3.jpg not downloaded yet
2026-04-22 13:13:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c224db37-f7a0-5b84-8d44-d6a796c68acd with identifier: 2788927
2026-04-22 13:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:13:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=MAGNETIC+GREY HTTP/1.1" 200 None
2026-04-22 13:13:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:13:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c224db37-f7a0-5b84-8d44-d6a796c68acd with identifier: 2788927
2026-04-22 13:13:38 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: c224db37-f7a0-5b84-8d44-d6a796c68acd with identifier: 2788927 to the API
2026-04-22 13:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:38 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id c224db37-f7a0-5b84-8d44-d6a796c68acd: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:37 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:38 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:38 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester - In Transit',
 'color': 'MAGNETIC GREY',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'c224db37-f7a0-5b84-8d44-d6a796c68acd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'EJ70FKB',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/PUMA?id=2788927',
 'listing': 'auction',
 'location': 'Manchester - In Transit',
 'longitude': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2020-11-09',
 'seller_name': None,
 'title': 'FORD PUMA 1.0 EcoBoost Hybrid mHEV ST-Line X 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV ST-Line X 5dr',
 'year': 2020}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:38 [manheim.gb] INFO: Saving data for 2788927: {'created_time': 1776863618.474098, 'last_price_update_time': 1776863618.474114}
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05d1bd0>
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594edbc-037c-5307-87ff-7cb1a723c9a0/f594edbc-037c-5307-87ff-7cb1a723c9a0_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_11.jpg saved to cache
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f594edbc-037c-5307-87ff-7cb1a723c9a0
2026-04-22 13:13:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46d4abbe-6743-5e64-b96f-d84cc3ae685e with identifier: 2800186
2026-04-22 13:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46d4abbe-6743-5e64-b96f-d84cc3ae685e with scrape type 1
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46d4abbe-6743-5e64-b96f-d84cc3ae685e
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_4.jpg not downloaded yet
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b07708d0>
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee29734-5ccc-537f-8c5b-153a6d1d0ad9/fee29734-5ccc-537f-8c5b-153a6d1d0ad9_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_10.jpg saved to cache
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fee29734-5ccc-537f-8c5b-153a6d1d0ad9
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0500a50>
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da610c7-a81d-5f21-81c5-7b68ce46fb14/6da610c7-a81d-5f21-81c5-7b68ce46fb14_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_10.jpg saved to cache
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6da610c7-a81d-5f21-81c5-7b68ce46fb14
2026-04-22 13:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2782935-4004071-6.jpg not downloaded yet
2026-04-22 13:13:38 [manheim.gb] INFO: Found listing with ID: 2829899
2026-04-22 13:13:38 [manheim.gb] INFO: Scrape type for 2829899: 0
2026-04-22 13:13:38 [manheim.gb] INFO: Found listing with ID: 2835277
2026-04-22 13:13:38 [manheim.gb] INFO: Scrape type for 2835277: 1
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-2.jpg not downloaded yet
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_ext_7.jpg not downloaded yet
2026-04-22 13:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2782935-4004071-4.jpg not downloaded yet
2026-04-22 13:13:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cb15ee3-61c0-5b74-b087-3a63d8556f53 with identifier: 2800451
2026-04-22 13:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cb15ee3-61c0-5b74-b087-3a63d8556f53 with scrape type 1
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3cb15ee3-61c0-5b74-b087-3a63d8556f53
2026-04-22 13:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_ext_7.jpg not downloaded yet
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1011510>
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9b5411c-ee9d-5461-80d0-11175c9fe85b/e9b5411c-ee9d-5461-80d0-11175c9fe85b_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_10.jpg saved to cache
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9b5411c-ee9d-5461-80d0-11175c9fe85b
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1776ad0>
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594edbc-037c-5307-87ff-7cb1a723c9a0/f594edbc-037c-5307-87ff-7cb1a723c9a0_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_10.jpg saved to cache
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f594edbc-037c-5307-87ff-7cb1a723c9a0
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1023790>
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da610c7-a81d-5f21-81c5-7b68ce46fb14/6da610c7-a81d-5f21-81c5-7b68ce46fb14_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_9.jpg saved to cache
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6da610c7-a81d-5f21-81c5-7b68ce46fb14
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b07706d0>
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594edbc-037c-5307-87ff-7cb1a723c9a0/f594edbc-037c-5307-87ff-7cb1a723c9a0_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_ext_2.jpg saved to cache
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f594edbc-037c-5307-87ff-7cb1a723c9a0
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03bb790>
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594edbc-037c-5307-87ff-7cb1a723c9a0/f594edbc-037c-5307-87ff-7cb1a723c9a0_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7acd764d-0e0a-40e7-abee-f491718e900b_9.jpg saved to cache
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f594edbc-037c-5307-87ff-7cb1a723c9a0
2026-04-22 13:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_2.jpg> (referer: None)
2026-04-22 13:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_9.jpg> (referer: None)
2026-04-22 13:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:39 [manheim.gb] INFO: Found listing with ID: 2836528
2026-04-22 13:13:39 [manheim.gb] INFO: Scrape type for 2836528: 1
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-1.jpg not downloaded yet
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_11.jpg not downloaded yet
2026-04-22 13:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_2.jpg> (referer: None)
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2782935-4004071-3.jpg not downloaded yet
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_ext_7.jpg not downloaded yet
2026-04-22 13:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81119c03-7c7d-5c4b-bc09-48a9aa4f0a0f with identifier: 2812219
2026-04-22 13:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81119c03-7c7d-5c4b-bc09-48a9aa4f0a0f with scrape type 1
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 3 photos for item 81119c03-7c7d-5c4b-bc09-48a9aa4f0a0f
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2026-04-22 13:13:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 81119c03-7c7d-5c4b-bc09-48a9aa4f0a0f, identifier: 2812219
2026-04-22 13:13:39 [manheim.gb] INFO: Found listing with ID: 2840015
2026-04-22 13:13:39 [manheim.gb] INFO: Scrape type for 2840015: 1
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_10.jpg not downloaded yet
2026-04-22 13:13:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 81119c03-7c7d-5c4b-bc09-48a9aa4f0a0f with identifier: 2812219
2026-04-22 13:13:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 81119c03-7c7d-5c4b-bc09-48a9aa4f0a0f with identifier: 2812219
2026-04-22 13:13:39 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 81119c03-7c7d-5c4b-bc09-48a9aa4f0a0f with identifier: 2812219 to the API
2026-04-22 13:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '81119c03-7c7d-5c4b-bc09-48a9aa4f0a0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'NY68WXX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2812219',
 'listing': 'auction',
 'location': 'Bristol',
 'longitude': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 555,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 3,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_410ff630-6543-5547-ae72-a20ded1fd770/410ff630-6543-5547-ae72-a20ded1fd770_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_410ff630-6543-5547-ae72-a20ded1fd770/410ff630-6543-5547-ae72-a20ded1fd770_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_410ff630-6543-5547-ae72-a20ded1fd770/410ff630-6543-5547-ae72-a20ded1fd770_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-02-28',
 'seller_name': None,
 'title': 'NISSAN JUKE 1.6 [112] Acenta 5dr',
 'transmission': 'manual',
 'trim': '1.6 [112] Acenta 5dr',
 'year': 2019}
2026-04-22 13:13:39 [manheim.gb] INFO: Saving data for 2812219: {'created_time': 1776863619.872318, 'last_price_update_time': 1776863619.87233}
2026-04-22 13:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42105cba-a05b-59d8-88d3-ee4a8ab5c2da with identifier: 2815577
2026-04-22 13:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42105cba-a05b-59d8-88d3-ee4a8ab5c2da with scrape type 1
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 42105cba-a05b-59d8-88d3-ee4a8ab5c2da
2026-04-22 13:13:39 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 42105cba-a05b-59d8-88d3-ee4a8ab5c2da
2026-04-22 13:13:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 42105cba-a05b-59d8-88d3-ee4a8ab5c2da, identifier: 2815577
2026-04-22 13:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_9.jpg> (referer: None)
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2782935-4004071-2.jpg not downloaded yet
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_ext_6.jpg not downloaded yet
2026-04-22 13:13:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 42105cba-a05b-59d8-88d3-ee4a8ab5c2da with identifier: 2815577
2026-04-22 13:13:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 42105cba-a05b-59d8-88d3-ee4a8ab5c2da with identifier: 2815577
2026-04-22 13:13:40 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 42105cba-a05b-59d8-88d3-ee4a8ab5c2da with identifier: 2815577 to the API
2026-04-22 13:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester - In Transit',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '42105cba-a05b-59d8-88d3-ee4a8ab5c2da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'MM68ZNF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=2815577',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'longitude': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 82619,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2019-02-19',
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 CRDi ISG 2 5dr',
 'transmission': 'manual',
 'trim': '1.6 CRDi ISG 2 5dr',
 'year': 2019}
2026-04-22 13:13:40 [manheim.gb] INFO: Saving data for 2815577: {'created_time': 1776863620.362138, 'last_price_update_time': 1776863620.362149}
2026-04-22 13:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:40 [manheim.gb] INFO: Found listing with ID: 2849221
2026-04-22 13:13:40 [manheim.gb] INFO: Scrape type for 2849221: 0
2026-04-22 13:13:40 [manheim.gb] INFO: Found listing with ID: 2857291
2026-04-22 13:13:40 [manheim.gb] INFO: Scrape type for 2857291: 1
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2800186-4167764-13.jpg not downloaded yet
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2b302d0>
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da610c7-a81d-5f21-81c5-7b68ce46fb14/6da610c7-a81d-5f21-81c5-7b68ce46fb14_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/295a4937-0098-4d7a-9317-6e69f5cb2e25_ext_2.jpg saved to cache
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6da610c7-a81d-5f21-81c5-7b68ce46fb14
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16e0590>
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee29734-5ccc-537f-8c5b-153a6d1d0ad9/fee29734-5ccc-537f-8c5b-153a6d1d0ad9_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_9.jpg saved to cache
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fee29734-5ccc-537f-8c5b-153a6d1d0ad9
2026-04-22 13:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2636e363-5b23-5023-8115-a1b0ad60c9bc with identifier: 2818070
2026-04-22 13:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2636e363-5b23-5023-8115-a1b0ad60c9bc with scrape type 1
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2636e363-5b23-5023-8115-a1b0ad60c9bc
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_ext_7.jpg not downloaded yet
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fa1710>
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee29734-5ccc-537f-8c5b-153a6d1d0ad9/fee29734-5ccc-537f-8c5b-153a6d1d0ad9_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fdfe9470-af97-415b-bed1-c63a36059238_ext_2.jpg saved to cache
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fee29734-5ccc-537f-8c5b-153a6d1d0ad9
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2782935-4004071-1.jpg not downloaded yet
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_ext_1.jpg not downloaded yet
2026-04-22 13:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_ext_4.jpg> (referer: None)
2026-04-22 13:13:40 [manheim.gb] INFO: Found listing with ID: 2861699
2026-04-22 13:13:40 [manheim.gb] INFO: Scrape type for 2861699: 0
2026-04-22 13:13:40 [manheim.gb] INFO: Found listing with ID: 2866076
2026-04-22 13:13:40 [manheim.gb] INFO: Scrape type for 2866076: 2
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_ext_4.jpg not downloaded yet
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_ext_7.jpg not downloaded yet
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05c4fd0>
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9b5411c-ee9d-5461-80d0-11175c9fe85b/e9b5411c-ee9d-5461-80d0-11175c9fe85b_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1348e740-15db-4348-adf4-234b913099d6_9.jpg saved to cache
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9b5411c-ee9d-5461-80d0-11175c9fe85b
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_5.jpg not downloaded yet
2026-04-22 13:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 708054e3-2419-5f37-bc37-16b6c103b8f2 with identifier: 2835277
2026-04-22 13:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 708054e3-2419-5f37-bc37-16b6c103b8f2 with scrape type 1
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 708054e3-2419-5f37-bc37-16b6c103b8f2
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 708054e3-2419-5f37-bc37-16b6c103b8f2
2026-04-22 13:13:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 708054e3-2419-5f37-bc37-16b6c103b8f2, identifier: 2835277
2026-04-22 13:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:40 [manheim.gb] INFO: Found listing with ID: 2866494
2026-04-22 13:13:40 [manheim.gb] INFO: Scrape type for 2866494: 0
2026-04-22 13:13:40 [manheim.gb] INFO: Found listing with ID: 2867135
2026-04-22 13:13:40 [manheim.gb] INFO: Scrape type for 2867135: 1
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_ext_3.jpg not downloaded yet
2026-04-22 13:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_ext_6.jpg not downloaded yet
2026-04-22 13:13:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 708054e3-2419-5f37-bc37-16b6c103b8f2 with identifier: 2835277
2026-04-22 13:13:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 708054e3-2419-5f37-bc37-16b6c103b8f2 with identifier: 2835277
2026-04-22 13:13:41 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 708054e3-2419-5f37-bc37-16b6c103b8f2 with identifier: 2835277 to the API
2026-04-22 13:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:41 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 708054e3-2419-5f37-bc37-16b6c103b8f2: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:40 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:41 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:41 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '708054e3-2419-5f37-bc37-16b6c103b8f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'AK08WYR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2835277',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2008-07-15',
 'seller_name': None,
 'title': 'VAUXHALL CORSA 1.4i 16V Design 5dr',
 'transmission': 'manual',
 'trim': '1.4i 16V Design 5dr',
 'year': 2008}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:41 [manheim.gb] INFO: Saving data for 2835277: {'created_time': 1776863621.277114, 'last_price_update_time': 1776863621.277127}
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_4.jpg not downloaded yet
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fcf990>
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1564fc4b-2135-534f-b5e1-a0e201401db8/1564fc4b-2135-534f-b5e1-a0e201401db8_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fad4ed9b-1d89-44c6-b019-5c33a8efddee_ext_4.jpg saved to cache
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1564fc4b-2135-534f-b5e1-a0e201401db8
2026-04-22 13:13:41 [manheim.gb] INFO: Found listing with ID: 2867170
2026-04-22 13:13:41 [manheim.gb] INFO: Scrape type for 2867170: 0
2026-04-22 13:13:41 [manheim.gb] INFO: Found listing with ID: 2867285
2026-04-22 13:13:41 [manheim.gb] INFO: Scrape type for 2867285: 0
2026-04-22 13:13:41 [manheim.gb] INFO: Found listing with ID: 2872533
2026-04-22 13:13:41 [manheim.gb] INFO: Scrape type for 2872533: 0
2026-04-22 13:13:41 [manheim.gb] INFO: Found listing with ID: 2874318
2026-04-22 13:13:41 [manheim.gb] INFO: Scrape type for 2874318: 1
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_ext_5.jpg not downloaded yet
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_ext_1.jpg not downloaded yet
2026-04-22 13:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2782935-4004071-8.jpg> (referer: None)
2026-04-22 13:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2697638-4170173-13.jpg> (referer: None)
2026-04-22 13:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-16.jpg> (referer: https://www.manheim.co.uk/search/vehiclebeautyimages/)
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_11.jpg not downloaded yet
2026-04-22 13:13:41 [manheim.gb] INFO: Found listing with ID: 2878366
2026-04-22 13:13:41 [manheim.gb] INFO: Scrape type for 2878366: 0
2026-04-22 13:13:41 [manheim.gb] INFO: Found listing with ID: 2878739
2026-04-22 13:13:41 [manheim.gb] INFO: Scrape type for 2878739: 1
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_ext_2.jpg not downloaded yet
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_5.jpg not downloaded yet
2026-04-22 13:13:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78d357fe-c0ce-53c8-978d-91c544e528f3 with identifier: 2840015
2026-04-22 13:13:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78d357fe-c0ce-53c8-978d-91c544e528f3 with scrape type 1
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78d357fe-c0ce-53c8-978d-91c544e528f3
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_ext_7.jpg not downloaded yet
2026-04-22 13:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-28.jpg> (referer: https://www.manheim.co.uk/search/vehiclebeautyimages/)
2026-04-22 13:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-13.jpg> (referer: https://www.manheim.co.uk/search/vehiclebeautyimages/)
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_10.jpg not downloaded yet
2026-04-22 13:13:41 [manheim.gb] INFO: Found listing with ID: 2879218
2026-04-22 13:13:41 [manheim.gb] INFO: Scrape type for 2879218: 0
2026-04-22 13:13:41 [manheim.gb] INFO: Found listing with ID: 2880782
2026-04-22 13:13:41 [manheim.gb] INFO: Scrape type for 2880782: 1
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_9.jpg not downloaded yet
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_4.jpg not downloaded yet
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_ext_7.jpg not downloaded yet
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_9.jpg not downloaded yet
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05000d0>
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22378020-615b-5fe9-8922-82281bc1ea3b/22378020-615b-5fe9-8922-82281bc1ea3b_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2782935-4004071-8.jpg saved to cache
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22378020-615b-5fe9-8922-82281bc1ea3b
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16cb590>
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1564fc4b-2135-534f-b5e1-a0e201401db8/1564fc4b-2135-534f-b5e1-a0e201401db8_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2697638-4170173-13.jpg saved to cache
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1564fc4b-2135-534f-b5e1-a0e201401db8
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0678110>
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cae527d-2d16-575c-ae7a-57f30d2ee322/1cae527d-2d16-575c-ae7a-57f30d2ee322_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-16.jpg saved to cache
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1cae527d-2d16-575c-ae7a-57f30d2ee322
2026-04-22 13:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:41 [manheim.gb] INFO: Found listing with ID: 2880944
2026-04-22 13:13:41 [manheim.gb] INFO: Scrape type for 2880944: 1
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_11.jpg not downloaded yet
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_ext_6.jpg not downloaded yet
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_ext_2.jpg not downloaded yet
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03a5450>
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cae527d-2d16-575c-ae7a-57f30d2ee322/1cae527d-2d16-575c-ae7a-57f30d2ee322_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-28.jpg saved to cache
2026-04-22 13:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cae527d-2d16-575c-ae7a-57f30d2ee322
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1776050>
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cae527d-2d16-575c-ae7a-57f30d2ee322/1cae527d-2d16-575c-ae7a-57f30d2ee322_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-13.jpg saved to cache
2026-04-22 13:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1cae527d-2d16-575c-ae7a-57f30d2ee322
2026-04-22 13:13:42 [manheim.gb] INFO: Found listing with ID: 2881872
2026-04-22 13:13:42 [manheim.gb] INFO: Scrape type for 2881872: 0
2026-04-22 13:13:42 [manheim.gb] INFO: Found listing with ID: 2884092
2026-04-22 13:13:42 [manheim.gb] INFO: Scrape type for 2884092: 0
2026-04-22 13:13:42 [manheim.gb] INFO: Found listing with ID: 2885602
2026-04-22 13:13:42 [manheim.gb] INFO: Scrape type for 2885602: 0
2026-04-22 13:13:42 [manheim.gb] INFO: Found listing with ID: 2894266
2026-04-22 13:13:42 [manheim.gb] INFO: Scrape type for 2894266: 1
2026-04-22 13:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_10.jpg not downloaded yet
2026-04-22 13:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_ext_1.jpg not downloaded yet
2026-04-22 13:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_ext_7.jpg> (referer: None)
2026-04-22 13:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_ext_7.jpg> (referer: None)
2026-04-22 13:13:42 [manheim.gb] INFO: Found listing with ID: 2899710
2026-04-22 13:13:42 [manheim.gb] INFO: Scrape type for 2899710: 1
2026-04-22 13:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_9.jpg not downloaded yet
2026-04-22 13:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_5.jpg not downloaded yet
2026-04-22 13:13:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93ce66e3-40d4-51e2-a6af-d91ca8e88a4c with identifier: 2874318
2026-04-22 13:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93ce66e3-40d4-51e2-a6af-d91ca8e88a4c with scrape type 1
2026-04-22 13:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 93ce66e3-40d4-51e2-a6af-d91ca8e88a4c
2026-04-22 13:13:42 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 93ce66e3-40d4-51e2-a6af-d91ca8e88a4c
2026-04-22 13:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 93ce66e3-40d4-51e2-a6af-d91ca8e88a4c, identifier: 2874318
2026-04-22 13:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-8.jpg> (referer: https://www.manheim.co.uk/search/vehiclebeautyimages/)
2026-04-22 13:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-6.jpg> (referer: https://www.manheim.co.uk/search/vehiclebeautyimages/)
2026-04-22 13:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 93ce66e3-40d4-51e2-a6af-d91ca8e88a4c with identifier: 2874318
2026-04-22 13:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 93ce66e3-40d4-51e2-a6af-d91ca8e88a4c with identifier: 2874318
2026-04-22 13:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 93ce66e3-40d4-51e2-a6af-d91ca8e88a4c with identifier: 2874318 to the API
2026-04-22 13:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:42 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 93ce66e3-40d4-51e2-a6af-d91ca8e88a4c: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:42 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:42 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:42 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Bristol - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '93ce66e3-40d4-51e2-a6af-d91ca8e88a4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YY18WNO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/TIPO?id=2874318',
 'listing': 'auction',
 'location': 'Bristol - In Transit',
 'longitude': None,
 'make': 'FIAT',
 'model': 'TIPO',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-06-30',
 'seller_name': None,
 'title': 'FIAT TIPO 1.6 Multijet Easy Plus 5dr',
 'transmission': 'manual',
 'trim': '1.6 Multijet Easy Plus 5dr',
 'year': 2018}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:42 [manheim.gb] INFO: Saving data for 2874318: {'created_time': 1776863622.751924, 'last_price_update_time': 1776863622.751935}
2026-04-22 13:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-2.jpg> (referer: https://www.manheim.co.uk/search/vehiclebeautyimages/)
2026-04-22 13:13:42 [manheim.gb] INFO: Found listing with ID: 2904715
2026-04-22 13:13:42 [manheim.gb] INFO: Scrape type for 2904715: 1
2026-04-22 13:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_ext_2.jpg not downloaded yet
2026-04-22 13:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_4.jpg not downloaded yet
2026-04-22 13:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2782935-4004071-6.jpg> (referer: None)
2026-04-22 13:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2782935-4004071-13.jpg> (referer: None)
2026-04-22 13:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_ext_7.jpg> (referer: None)
2026-04-22 13:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_10.jpg> (referer: None)
2026-04-22 13:13:42 [manheim.gb] INFO: Found listing with ID: 2905177
2026-04-22 13:13:42 [manheim.gb] INFO: Scrape type for 2905177: 0
2026-04-22 13:13:42 [manheim.gb] INFO: Found listing with ID: 2906755
2026-04-22 13:13:42 [manheim.gb] INFO: Scrape type for 2906755: 1
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_11.jpg not downloaded yet
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fa1a50>
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d4abbe-6743-5e64-b96f-d84cc3ae685e/46d4abbe-6743-5e64-b96f-d84cc3ae685e_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_ext_7.jpg saved to cache
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46d4abbe-6743-5e64-b96f-d84cc3ae685e
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b068f5d0>
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cb15ee3-61c0-5b74-b087-3a63d8556f53/3cb15ee3-61c0-5b74-b087-3a63d8556f53_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_ext_7.jpg saved to cache
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3cb15ee3-61c0-5b74-b087-3a63d8556f53
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1013850>
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cae527d-2d16-575c-ae7a-57f30d2ee322/1cae527d-2d16-575c-ae7a-57f30d2ee322_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-8.jpg saved to cache
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1cae527d-2d16-575c-ae7a-57f30d2ee322
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03b8910>
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cae527d-2d16-575c-ae7a-57f30d2ee322/1cae527d-2d16-575c-ae7a-57f30d2ee322_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-6.jpg saved to cache
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1cae527d-2d16-575c-ae7a-57f30d2ee322
2026-04-22 13:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:43 [manheim.gb] INFO: Found listing with ID: 2907243
2026-04-22 13:13:43 [manheim.gb] INFO: Scrape type for 2907243: 1
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_10.jpg not downloaded yet
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1774950>
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cae527d-2d16-575c-ae7a-57f30d2ee322/1cae527d-2d16-575c-ae7a-57f30d2ee322_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-2.jpg saved to cache
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1cae527d-2d16-575c-ae7a-57f30d2ee322
2026-04-22 13:13:43 [manheim.gb] INFO: Found listing with ID: 2907963
2026-04-22 13:13:43 [manheim.gb] INFO: Scrape type for 2907963: 0
2026-04-22 13:13:43 [manheim.gb] INFO: Found listing with ID: 2909317
2026-04-22 13:13:43 [manheim.gb] INFO: Scrape type for 2909317: 1
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_9.jpg not downloaded yet
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b057ab50>
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22378020-615b-5fe9-8922-82281bc1ea3b/22378020-615b-5fe9-8922-82281bc1ea3b_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2782935-4004071-6.jpg saved to cache
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22378020-615b-5fe9-8922-82281bc1ea3b
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04bc1d0>
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22378020-615b-5fe9-8922-82281bc1ea3b/22378020-615b-5fe9-8922-82281bc1ea3b_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2782935-4004071-13.jpg saved to cache
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22378020-615b-5fe9-8922-82281bc1ea3b
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0552750>
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2636e363-5b23-5023-8115-a1b0ad60c9bc/2636e363-5b23-5023-8115-a1b0ad60c9bc_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_ext_7.jpg saved to cache
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2636e363-5b23-5023-8115-a1b0ad60c9bc
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b106eb10>
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d4abbe-6743-5e64-b96f-d84cc3ae685e/46d4abbe-6743-5e64-b96f-d84cc3ae685e_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_10.jpg saved to cache
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46d4abbe-6743-5e64-b96f-d84cc3ae685e
2026-04-22 13:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-4.jpg> (referer: https://www.manheim.co.uk/search/vehiclebeautyimages/)
2026-04-22 13:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_5.jpg> (referer: None)
2026-04-22 13:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_ext_1.jpg> (referer: None)
2026-04-22 13:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_ext_5.jpg> (referer: None)
2026-04-22 13:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_4.jpg> (referer: None)
2026-04-22 13:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_11.jpg> (referer: None)
2026-04-22 13:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_9.jpg> (referer: None)
2026-04-22 13:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:43 [manheim.gb] INFO: Found listing with ID: 2912182
2026-04-22 13:13:43 [manheim.gb] INFO: Scrape type for 2912182: 0
2026-04-22 13:13:43 [manheim.gb] INFO: Found listing with ID: 2916497
2026-04-22 13:13:43 [manheim.gb] INFO: Scrape type for 2916497: 1
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_ext_2.jpg not downloaded yet
2026-04-22 13:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_ext_2.jpg> (referer: None)
2026-04-22 13:13:43 [manheim.gb] INFO: Found listing with ID: 2919339
2026-04-22 13:13:43 [manheim.gb] INFO: Scrape type for 2919339: 0
2026-04-22 13:13:43 [manheim.gb] INFO: Found listing with ID: 2926097
2026-04-22 13:13:43 [manheim.gb] INFO: Scrape type for 2926097: 1
2026-04-22 13:13:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d5f9740-e0c1-5784-a204-f48d380e3d36 with identifier: 2899710
2026-04-22 13:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d5f9740-e0c1-5784-a204-f48d380e3d36 with scrape type 1
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d5f9740-e0c1-5784-a204-f48d380e3d36
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_ext_4.jpg not downloaded yet
2026-04-22 13:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:43 [manheim.gb] INFO: Found listing with ID: 2929709
2026-04-22 13:13:43 [manheim.gb] INFO: Scrape type for 2929709: 0
2026-04-22 13:13:43 [manheim.gb] INFO: Found listing with ID: 2932048
2026-04-22 13:13:43 [manheim.gb] INFO: Scrape type for 2932048: 1
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_ext_7.jpg not downloaded yet
2026-04-22 13:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:43 [manheim.gb] INFO: Found listing with ID: 2936325
2026-04-22 13:13:43 [manheim.gb] INFO: Scrape type for 2936325: 0
2026-04-22 13:13:43 [manheim.gb] INFO: Found listing with ID: 2936665
2026-04-22 13:13:43 [manheim.gb] INFO: Scrape type for 2936665: 1
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_ext_3.jpg not downloaded yet
2026-04-22 13:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_9.jpg> (referer: None)
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0f9e050>
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cae527d-2d16-575c-ae7a-57f30d2ee322/1cae527d-2d16-575c-ae7a-57f30d2ee322_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-2766058-2736463-4.jpg saved to cache
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1cae527d-2d16-575c-ae7a-57f30d2ee322
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b101ee50>
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cb15ee3-61c0-5b74-b087-3a63d8556f53/3cb15ee3-61c0-5b74-b087-3a63d8556f53_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_5.jpg saved to cache
2026-04-22 13:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3cb15ee3-61c0-5b74-b087-3a63d8556f53
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0508d90>
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2636e363-5b23-5023-8115-a1b0ad60c9bc/2636e363-5b23-5023-8115-a1b0ad60c9bc_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_ext_1.jpg saved to cache
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2636e363-5b23-5023-8115-a1b0ad60c9bc
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03cf150>
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d4abbe-6743-5e64-b96f-d84cc3ae685e/46d4abbe-6743-5e64-b96f-d84cc3ae685e_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/12209161-ab9a-45e5-bd38-6b41d2e2a178_ext_5.jpg saved to cache
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46d4abbe-6743-5e64-b96f-d84cc3ae685e
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06547d0>
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cb15ee3-61c0-5b74-b087-3a63d8556f53/3cb15ee3-61c0-5b74-b087-3a63d8556f53_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_4.jpg saved to cache
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3cb15ee3-61c0-5b74-b087-3a63d8556f53
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b072cb90>
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cb15ee3-61c0-5b74-b087-3a63d8556f53/3cb15ee3-61c0-5b74-b087-3a63d8556f53_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_11.jpg saved to cache
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3cb15ee3-61c0-5b74-b087-3a63d8556f53
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b052f390>
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cb15ee3-61c0-5b74-b087-3a63d8556f53/3cb15ee3-61c0-5b74-b087-3a63d8556f53_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_9.jpg saved to cache
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3cb15ee3-61c0-5b74-b087-3a63d8556f53
2026-04-22 13:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9963dc62-2b0e-5036-9a4c-5267260b6641 with identifier: 2904715
2026-04-22 13:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9963dc62-2b0e-5036-9a4c-5267260b6641 with scrape type 1
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9963dc62-2b0e-5036-9a4c-5267260b6641
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2904715-2709790-13.jpg not downloaded yet
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b100b050>
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cb15ee3-61c0-5b74-b087-3a63d8556f53/3cb15ee3-61c0-5b74-b087-3a63d8556f53_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/997808b0-39d0-43e9-9b9f-64031e741645_ext_2.jpg saved to cache
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3cb15ee3-61c0-5b74-b087-3a63d8556f53
2026-04-22 13:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_5.jpg> (referer: None)
2026-04-22 13:13:44 [manheim.gb] INFO: Found listing with ID: 2937042
2026-04-22 13:13:44 [manheim.gb] INFO: Scrape type for 2937042: 0
2026-04-22 13:13:44 [manheim.gb] INFO: Found listing with ID: 2938053
2026-04-22 13:13:44 [manheim.gb] INFO: Scrape type for 2938053: 0
2026-04-22 13:13:44 [manheim.gb] INFO: Found listing with ID: 2943985
2026-04-22 13:13:44 [manheim.gb] INFO: Scrape type for 2943985: 0
2026-04-22 13:13:44 [manheim.gb] INFO: Found listing with ID: 2947488
2026-04-22 13:13:44 [manheim.gb] INFO: Scrape type for 2947488: 0
2026-04-22 13:13:44 [manheim.gb] INFO: Found listing with ID: 2949645
2026-04-22 13:13:44 [manheim.gb] INFO: Scrape type for 2949645: 1
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_ext_5.jpg not downloaded yet
2026-04-22 13:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_ext_2.jpg> (referer: None)
2026-04-22 13:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_4.jpg> (referer: None)
2026-04-22 13:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_ext_6.jpg> (referer: None)
2026-04-22 13:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_ext_1.jpg> (referer: None)
2026-04-22 13:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_ext_7.jpg not downloaded yet
2026-04-22 13:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_11.jpg> (referer: None)
2026-04-22 13:13:44 [manheim.gb] INFO: Found listing with ID: 2949906
2026-04-22 13:13:44 [manheim.gb] INFO: Scrape type for 2949906: 0
2026-04-22 13:13:44 [manheim.gb] INFO: Found listing with ID: 2956287
2026-04-22 13:13:44 [manheim.gb] INFO: Scrape type for 2956287: 0
2026-04-22 13:13:44 [manheim.gb] INFO: Found listing with ID: 2957148
2026-04-22 13:13:44 [manheim.gb] INFO: Scrape type for 2957148: 0
2026-04-22 13:13:44 [manheim.gb] INFO: Found listing with ID: 2959818
2026-04-22 13:13:44 [manheim.gb] INFO: Scrape type for 2959818: 1
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_ext_2.jpg not downloaded yet
2026-04-22 13:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9850b3ac-1cc2-5902-9c4f-c19b91fbedbf with identifier: 2909317
2026-04-22 13:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9850b3ac-1cc2-5902-9c4f-c19b91fbedbf with scrape type 1
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9850b3ac-1cc2-5902-9c4f-c19b91fbedbf
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2909317-2712883-13.jpg not downloaded yet
2026-04-22 13:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8b125e0-83e0-5438-bc48-281f0867ab56 with identifier: 2880944
2026-04-22 13:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8b125e0-83e0-5438-bc48-281f0867ab56 with scrape type 1
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8b125e0-83e0-5438-bc48-281f0867ab56
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_4.jpg not downloaded yet
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1749a50>
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2636e363-5b23-5023-8115-a1b0ad60c9bc/2636e363-5b23-5023-8115-a1b0ad60c9bc_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_9.jpg saved to cache
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2636e363-5b23-5023-8115-a1b0ad60c9bc
2026-04-22 13:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_9.jpg> (referer: None)
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_ext_4.jpg not downloaded yet
2026-04-22 13:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:44 [manheim.gb] INFO: Found listing with ID: 2960939
2026-04-22 13:13:44 [manheim.gb] INFO: Scrape type for 2960939: 2
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_9.jpg not downloaded yet
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-012.jpg not downloaded yet
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_7.jpg not downloaded yet
2026-04-22 13:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_10.jpg> (referer: None)
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_ext_3.jpg not downloaded yet
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04ea550>
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d357fe-c0ce-53c8-978d-91c544e528f3/78d357fe-c0ce-53c8-978d-91c544e528f3_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_5.jpg saved to cache
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78d357fe-c0ce-53c8-978d-91c544e528f3
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04d8410>
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2636e363-5b23-5023-8115-a1b0ad60c9bc/2636e363-5b23-5023-8115-a1b0ad60c9bc_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_ext_2.jpg saved to cache
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2636e363-5b23-5023-8115-a1b0ad60c9bc
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0678b50>
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d357fe-c0ce-53c8-978d-91c544e528f3/78d357fe-c0ce-53c8-978d-91c544e528f3_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_4.jpg saved to cache
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78d357fe-c0ce-53c8-978d-91c544e528f3
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b175ca50>
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d357fe-c0ce-53c8-978d-91c544e528f3/78d357fe-c0ce-53c8-978d-91c544e528f3_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_ext_6.jpg saved to cache
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78d357fe-c0ce-53c8-978d-91c544e528f3
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06f9e50>
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d357fe-c0ce-53c8-978d-91c544e528f3/78d357fe-c0ce-53c8-978d-91c544e528f3_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_ext_1.jpg saved to cache
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78d357fe-c0ce-53c8-978d-91c544e528f3
2026-04-22 13:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79cb74b2-007c-5b35-8739-4707bfc22f73 with identifier: 2894266
2026-04-22 13:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79cb74b2-007c-5b35-8739-4707bfc22f73 with scrape type 1
2026-04-22 13:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79cb74b2-007c-5b35-8739-4707bfc22f73
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_ext_7.jpg not downloaded yet
2026-04-22 13:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1882fd0>
2026-04-22 13:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d357fe-c0ce-53c8-978d-91c544e528f3/78d357fe-c0ce-53c8-978d-91c544e528f3_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_11.jpg saved to cache
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78d357fe-c0ce-53c8-978d-91c544e528f3
2026-04-22 13:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_11.jpg> (referer: None)
2026-04-22 13:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:45 [manheim.gb] INFO: Found listing with ID: 2962607
2026-04-22 13:13:45 [manheim.gb] INFO: Scrape type for 2962607: 2
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_10.jpg not downloaded yet
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-011.jpg not downloaded yet
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_3.jpg not downloaded yet
2026-04-22 13:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_10.jpg> (referer: None)
2026-04-22 13:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_ext_4.jpg> (referer: None)
2026-04-22 13:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_ext_7.jpg> (referer: None)
2026-04-22 13:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_ext_3.jpg> (referer: None)
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_ext_5.jpg not downloaded yet
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_ext_7.jpg not downloaded yet
2026-04-22 13:13:45 [manheim.gb] INFO: Found listing with ID: 2970217
2026-04-22 13:13:45 [manheim.gb] INFO: Scrape type for 2970217: 1
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_11.jpg not downloaded yet
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-010.jpg not downloaded yet
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_5.jpg not downloaded yet
2026-04-22 13:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1084ad0>
2026-04-22 13:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d357fe-c0ce-53c8-978d-91c544e528f3/78d357fe-c0ce-53c8-978d-91c544e528f3_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_9.jpg saved to cache
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 78d357fe-c0ce-53c8-978d-91c544e528f3
2026-04-22 13:13:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a0bd54d-5c90-524d-b116-662395ae3b6e with identifier: 2932048
2026-04-22 13:13:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a0bd54d-5c90-524d-b116-662395ae3b6e with scrape type 1
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3a0bd54d-5c90-524d-b116-662395ae3b6e
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3a0bd54d-5c90-524d-b116-662395ae3b6e
2026-04-22 13:13:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3a0bd54d-5c90-524d-b116-662395ae3b6e, identifier: 2932048
2026-04-22 13:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2daa050>
2026-04-22 13:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2636e363-5b23-5023-8115-a1b0ad60c9bc/2636e363-5b23-5023-8115-a1b0ad60c9bc_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_10.jpg saved to cache
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2636e363-5b23-5023-8115-a1b0ad60c9bc
2026-04-22 13:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_ext_2.jpg not downloaded yet
2026-04-22 13:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_ext_6.jpg not downloaded yet
2026-04-22 13:13:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3a0bd54d-5c90-524d-b116-662395ae3b6e with identifier: 2932048
2026-04-22 13:13:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3a0bd54d-5c90-524d-b116-662395ae3b6e with identifier: 2932048
2026-04-22 13:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 3a0bd54d-5c90-524d-b116-662395ae3b6e with identifier: 2932048 to the API
2026-04-22 13:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:46 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 3a0bd54d-5c90-524d-b116-662395ae3b6e: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:45 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:46 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:46 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Birmingham - In Transit',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '3a0bd54d-5c90-524d-b116-662395ae3b6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'OE70YHR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HONDA/CIVIC?id=2932048',
 'listing': 'auction',
 'location': 'Birmingham - In Transit',
 'longitude': None,
 'make': 'HONDA',
 'model': 'CIVIC',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2021-01-15',
 'seller_name': None,
 'title': 'HONDA CIVIC 1.0 VTEC Turbo 126 SR 5dr',
 'transmission': 'manual',
 'trim': '1.0 VTEC Turbo 126 SR 5dr',
 'year': 2021}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:46 [manheim.gb] INFO: Saving data for 2932048: {'created_time': 1776863626.198652, 'last_price_update_time': 1776863626.198665}
2026-04-22 13:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_ext_5.jpg> (referer: None)
2026-04-22 13:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:46 [manheim.gb] INFO: Found listing with ID: 2971032
2026-04-22 13:13:46 [manheim.gb] INFO: Scrape type for 2971032: 1
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_4.jpg not downloaded yet
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-009.jpg not downloaded yet
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_2.jpg not downloaded yet
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_9.jpg not downloaded yet
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_ext_1.jpg not downloaded yet
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0511150>
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2636e363-5b23-5023-8115-a1b0ad60c9bc/2636e363-5b23-5023-8115-a1b0ad60c9bc_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/516bf8b2-7cab-4ee2-9cc0-0a1858ed4f64_11.jpg saved to cache
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2636e363-5b23-5023-8115-a1b0ad60c9bc
2026-04-22 13:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fad9baf3-07c3-595e-bcdf-c355fe3108ac with identifier: 2907243
2026-04-22 13:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fad9baf3-07c3-595e-bcdf-c355fe3108ac with scrape type 1
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item fad9baf3-07c3-595e-bcdf-c355fe3108ac
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item fad9baf3-07c3-595e-bcdf-c355fe3108ac
2026-04-22 13:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fad9baf3-07c3-595e-bcdf-c355fe3108ac, identifier: 2907243
2026-04-22 13:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d91c27-df92-538d-9c28-d248ce920f46 with identifier: 2949645
2026-04-22 13:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d91c27-df92-538d-9c28-d248ce920f46 with scrape type 1
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6d91c27-df92-538d-9c28-d248ce920f46
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_7.jpg not downloaded yet
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2b1ed90>
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d357fe-c0ce-53c8-978d-91c544e528f3/78d357fe-c0ce-53c8-978d-91c544e528f3_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_10.jpg saved to cache
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78d357fe-c0ce-53c8-978d-91c544e528f3
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b05421d0>
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d5f9740-e0c1-5784-a204-f48d380e3d36/9d5f9740-e0c1-5784-a204-f48d380e3d36_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_ext_4.jpg saved to cache
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d5f9740-e0c1-5784-a204-f48d380e3d36
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1728cd0>
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d5f9740-e0c1-5784-a204-f48d380e3d36/9d5f9740-e0c1-5784-a204-f48d380e3d36_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_ext_7.jpg saved to cache
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d5f9740-e0c1-5784-a204-f48d380e3d36
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b14c6550>
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d5f9740-e0c1-5784-a204-f48d380e3d36/9d5f9740-e0c1-5784-a204-f48d380e3d36_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_ext_3.jpg saved to cache
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d5f9740-e0c1-5784-a204-f48d380e3d36
2026-04-22 13:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_ext_7.jpg> (referer: None)
2026-04-22 13:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_ext_4.jpg> (referer: None)
2026-04-22 13:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-012.jpg> (referer: None)
2026-04-22 13:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:46 [manheim.gb] INFO: Found listing with ID: 2974431
2026-04-22 13:13:46 [manheim.gb] INFO: Scrape type for 2974431: 0
2026-04-22 13:13:46 [manheim.gb] INFO: Found listing with ID: 297650
2026-04-22 13:13:46 [manheim.gb] INFO: Scrape type for 297650: 1
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_5.jpg not downloaded yet
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-007.jpg not downloaded yet
2026-04-22 13:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_9.jpg not downloaded yet
2026-04-22 13:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fad9baf3-07c3-595e-bcdf-c355fe3108ac with identifier: 2907243
2026-04-22 13:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:13:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE HTTP/1.1" 200 None
2026-04-22 13:13:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fad9baf3-07c3-595e-bcdf-c355fe3108ac with identifier: 2907243
2026-04-22 13:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: fad9baf3-07c3-595e-bcdf-c355fe3108ac with identifier: 2907243 to the API
2026-04-22 13:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:47 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id fad9baf3-07c3-595e-bcdf-c355fe3108ac: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:46 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:47 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:47 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Plymouth - In Transit',
 'color': 'ORANGE',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': None,
 'fuel_type': 'Electric',
 'id': 'fad9baf3-07c3-595e-bcdf-c355fe3108ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'WM70ZFR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/HATCHBACK?id=2907243',
 'listing': 'auction',
 'location': 'Plymouth - In Transit',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'HATCHBACK',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2021-01-27',
 'seller_name': None,
 'title': 'VAUXHALL HATCHBACK 100kW Elite Nav 50kWh 5dr Auto [7.4kWCh]',
 'transmission': 'automatic',
 'trim': '100kW Elite Nav 50kWh 5dr Auto [7.4kWCh]',
 'year': 2021}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:47 [manheim.gb] INFO: Saving data for 2907243: {'created_time': 1776863627.436211, 'last_price_update_time': 1776863627.436225}
2026-04-22 13:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2904715-2709790-13.jpg> (referer: None)
2026-04-22 13:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_4.jpg> (referer: None)
2026-04-22 13:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_7.jpg> (referer: None)
2026-04-22 13:13:47 [scrapy.extensions.logstats] INFO: Crawled 238 pages (at 93 pages/min), scraped 117 items (at 47 items/min)
2026-04-22 13:13:47 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-04-22 13:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_10.jpg not downloaded yet
2026-04-22 13:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_5.jpg not downloaded yet
2026-04-22 13:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_7.jpg not downloaded yet
2026-04-22 13:13:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b34a58e-dd54-593f-a5ff-b5194e398def with identifier: 2906755
2026-04-22 13:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b34a58e-dd54-593f-a5ff-b5194e398def with scrape type 1
2026-04-22 13:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2b34a58e-dd54-593f-a5ff-b5194e398def
2026-04-22 13:13:47 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2b34a58e-dd54-593f-a5ff-b5194e398def
2026-04-22 13:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2b34a58e-dd54-593f-a5ff-b5194e398def, identifier: 2906755
2026-04-22 13:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_ext_2.jpg> (referer: None)
2026-04-22 13:13:47 [manheim.gb] INFO: Found listing with ID: 297938
2026-04-22 13:13:47 [manheim.gb] INFO: Scrape type for 297938: 1
2026-04-22 13:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-006.jpg not downloaded yet
2026-04-22 13:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_10.jpg not downloaded yet
2026-04-22 13:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2b34a58e-dd54-593f-a5ff-b5194e398def with identifier: 2906755
2026-04-22 13:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2b34a58e-dd54-593f-a5ff-b5194e398def with identifier: 2906755
2026-04-22 13:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 2b34a58e-dd54-593f-a5ff-b5194e398def with identifier: 2906755 to the API
2026-04-22 13:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:47 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 2b34a58e-dd54-593f-a5ff-b5194e398def: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:47 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:47 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:47 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Manchester - In Transit',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '2b34a58e-dd54-593f-a5ff-b5194e398def',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'DP68CXJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=2906755',
 'listing': 'auction',
 'location': 'Manchester - In Transit',
 'longitude': None,
 'make': 'VAUXHALL',
 'model': 'ASTRA',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-12-31',
 'seller_name': None,
 'title': 'VAUXHALL ASTRA 1.6T 16V 200 Elite Nav 5dr',
 'transmission': 'manual',
 'trim': '1.6T 16V 200 Elite Nav 5dr',
 'year': 2018}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:48 [manheim.gb] INFO: Saving data for 2906755: {'created_time': 1776863628.002492, 'last_price_update_time': 1776863628.002503}
2026-04-22 13:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b057ba50>
2026-04-22 13:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d5f9740-e0c1-5784-a204-f48d380e3d36/9d5f9740-e0c1-5784-a204-f48d380e3d36_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_ext_5.jpg saved to cache
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d5f9740-e0c1-5784-a204-f48d380e3d36
2026-04-22 13:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a00b9a75-bde4-50e7-b9c0-45d61486218f with identifier: 2936665
2026-04-22 13:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a00b9a75-bde4-50e7-b9c0-45d61486218f with scrape type 1
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a00b9a75-bde4-50e7-b9c0-45d61486218f
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936665-4167066-13.jpg not downloaded yet
2026-04-22 13:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feec5448-3621-5126-8ab1-50a58c2b5a26 with identifier: 2926097
2026-04-22 13:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feec5448-3621-5126-8ab1-50a58c2b5a26 with scrape type 1
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item feec5448-3621-5126-8ab1-50a58c2b5a26
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item feec5448-3621-5126-8ab1-50a58c2b5a26
2026-04-22 13:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: feec5448-3621-5126-8ab1-50a58c2b5a26, identifier: 2926097
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_11.jpg not downloaded yet
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_4.jpg not downloaded yet
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_6.jpg not downloaded yet
2026-04-22 13:13:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: feec5448-3621-5126-8ab1-50a58c2b5a26 with identifier: 2926097
2026-04-22 13:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-22 13:13:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=NERA+BLACK HTTP/1.1" 200 None
2026-04-22 13:13:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-22 13:13:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: feec5448-3621-5126-8ab1-50a58c2b5a26 with identifier: 2926097
2026-04-22 13:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: feec5448-3621-5126-8ab1-50a58c2b5a26 with identifier: 2926097 to the API
2026-04-22 13:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 500 None
2026-04-22 13:13:48 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id feec5448-3621-5126-8ab1-50a58c2b5a26: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 500
 | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
 | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:48 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-04-22 13:13:48 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
Traceback (most recent call last):
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:48 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Leeds - In Transit',
 'color': 'NERA BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'feec5448-3621-5126-8ab1-50a58c2b5a26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'KV70ZTR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/308?id=2926097',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'longitude': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': None,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2020-09-18',
 'seller_name': None,
 'title': 'PEUGEOT 308 1.2 PureTech 130 Allure 5dr [Digital i-Cockpit]',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 Allure 5dr [Digital i-Cockpit]',
 'year': 2020}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
    return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
    raise e
  File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
    response.raise_for_status()
  File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-22 13:13:48 [manheim.gb] INFO: Saving data for 2926097: {'created_time': 1776863628.781174, 'last_price_update_time': 1776863628.781186}
2026-04-22 13:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_9.jpg> (referer: None)
2026-04-22 13:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:48 [manheim.gb] INFO: Found listing with ID: 2981871
2026-04-22 13:13:48 [manheim.gb] INFO: Scrape type for 2981871: 0
2026-04-22 13:13:48 [manheim.gb] INFO: Found listing with ID: 2982957
2026-04-22 13:13:48 [manheim.gb] INFO: Scrape type for 2982957: 0
2026-04-22 13:13:48 [manheim.gb] INFO: Found listing with ID: 2983733
2026-04-22 13:13:48 [manheim.gb] INFO: Scrape type for 2983733: 1
2026-04-22 13:13:48 [manheim.gb] ERROR: Error extracting listing 2983733: Field transmission is not nullable
2026-04-22 13:13:48 [manheim.gb] INFO: Found listing with ID: 2983738
2026-04-22 13:13:48 [manheim.gb] INFO: Scrape type for 2983738: 0
2026-04-22 13:13:48 [manheim.gb] INFO: Found listing with ID: 2987141
2026-04-22 13:13:48 [manheim.gb] INFO: Scrape type for 2987141: 1
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-005.jpg not downloaded yet
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_11.jpg not downloaded yet
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_7.jpg not downloaded yet
2026-04-22 13:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0430350>
2026-04-22 13:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9963dc62-2b0e-5036-9a4c-5267260b6641/9963dc62-2b0e-5036-9a4c-5267260b6641_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_ext_7.jpg saved to cache
2026-04-22 13:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9963dc62-2b0e-5036-9a4c-5267260b6641
2026-04-22 13:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04a42d0>
2026-04-22 13:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9963dc62-2b0e-5036-9a4c-5267260b6641/9963dc62-2b0e-5036-9a4c-5267260b6641_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_ext_4.jpg saved to cache
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9963dc62-2b0e-5036-9a4c-5267260b6641
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b076c950>
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9850b3ac-1cc2-5902-9c4f-c19b91fbedbf/9850b3ac-1cc2-5902-9c4f-c19b91fbedbf_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-012.jpg saved to cache
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9850b3ac-1cc2-5902-9c4f-c19b91fbedbf
2026-04-22 13:13:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f22caae-d370-5d83-a734-5ce4ce67ed6d with identifier: 2962607
2026-04-22 13:13:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f22caae-d370-5d83-a734-5ce4ce67ed6d with scrape type 2
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f22caae-d370-5d83-a734-5ce4ce67ed6d with scrape type 2
2026-04-22 13:13:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0f22caae-d370-5d83-a734-5ce4ce67ed6d, identifier: 2962607
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b045fa90>
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9963dc62-2b0e-5036-9a4c-5267260b6641/9963dc62-2b0e-5036-9a4c-5267260b6641_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2904715-2709790-13.jpg saved to cache
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9963dc62-2b0e-5036-9a4c-5267260b6641
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1757190>
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b125e0-83e0-5438-bc48-281f0867ab56/e8b125e0-83e0-5438-bc48-281f0867ab56_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_4.jpg saved to cache
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8b125e0-83e0-5438-bc48-281f0867ab56
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1894410>
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b125e0-83e0-5438-bc48-281f0867ab56/e8b125e0-83e0-5438-bc48-281f0867ab56_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_7.jpg saved to cache
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8b125e0-83e0-5438-bc48-281f0867ab56
2026-04-22 13:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_10.jpg> (referer: None)
2026-04-22 13:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-011.jpg> (referer: None)
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_4.jpg not downloaded yet
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_11.jpg not downloaded yet
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_1.jpg not downloaded yet
2026-04-22 13:13:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0f22caae-d370-5d83-a734-5ce4ce67ed6d with identifier: 2962607
2026-04-22 13:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0f22caae-d370-5d83-a734-5ce4ce67ed6d with identifier: 2962607
2026-04-22 13:13:49 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0f22caae-d370-5d83-a734-5ce4ce67ed6d with identifier: 2962607 to the API
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-22 13:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'car_expert_report_source_url': None,
 'city': 'Colchester',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '0f22caae-d370-5d83-a734-5ce4ce67ed6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'license_plate': 'YH68AVP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A4?id=2962607',
 'listing': 'auction',
 'location': 'Colchester',
 'longitude': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 89486,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'region': None,
 'registration_date': '2018-09-28',
 'seller_name': None,
 'title': 'AUDI A4 2.0 TDI Ultra SE 4dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Ultra SE 4dr',
 'year': 2018}
2026-04-22 13:13:49 [manheim.gb] INFO: Saving data for 2962607: {'created_time': 1776247815.82861, 'last_price_update_time': 1776863629.742205}
2026-04-22 13:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_3.jpg> (referer: None)
2026-04-22 13:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_ext_2.jpg> (referer: None)
2026-04-22 13:13:49 [manheim.gb] INFO: Found listing with ID: 2987750
2026-04-22 13:13:49 [manheim.gb] INFO: Scrape type for 2987750: 0
2026-04-22 13:13:49 [manheim.gb] INFO: Found listing with ID: 2988223
2026-04-22 13:13:49 [manheim.gb] INFO: Scrape type for 2988223: 0
2026-04-22 13:13:49 [manheim.gb] INFO: Found listing with ID: 2992528
2026-04-22 13:13:49 [manheim.gb] INFO: Scrape type for 2992528: 1
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-003.jpg not downloaded yet
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_4.jpg not downloaded yet
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_4.jpg not downloaded yet
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b045cd50>
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d357fe-c0ce-53c8-978d-91c544e528f3/78d357fe-c0ce-53c8-978d-91c544e528f3_image_9.jpg HTTP/1.1" 201 0
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b4b5d11-03ec-42be-9c0a-0a18a1ec9ef6_ext_2.jpg saved to cache
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 78d357fe-c0ce-53c8-978d-91c544e528f3
2026-04-22 13:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_ext_6.jpg> (referer: None)
2026-04-22 13:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_ext_7.jpg> (referer: None)
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_10.jpg not downloaded yet
2026-04-22 13:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_5.jpg not downloaded yet
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0745c10>
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d5f9740-e0c1-5784-a204-f48d380e3d36/9d5f9740-e0c1-5784-a204-f48d380e3d36_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_9.jpg saved to cache
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d5f9740-e0c1-5784-a204-f48d380e3d36
2026-04-22 13:13:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bdc228b-ee46-510c-b98a-2a3d2231e7cd with identifier: 2971032
2026-04-22 13:13:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bdc228b-ee46-510c-b98a-2a3d2231e7cd with scrape type 1
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8bdc228b-ee46-510c-b98a-2a3d2231e7cd
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-010.jpg not downloaded yet
2026-04-22 13:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_5.jpg> (referer: None)
2026-04-22 13:13:50 [manheim.gb] INFO: Found listing with ID: 2994116
2026-04-22 13:13:50 [manheim.gb] INFO: Scrape type for 2994116: 1
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-002.jpg not downloaded yet
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_5.jpg not downloaded yet
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_3.jpg not downloaded yet
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_9.jpg not downloaded yet
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_4.jpg not downloaded yet
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-009.jpg not downloaded yet
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03d2050>
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d5f9740-e0c1-5784-a204-f48d380e3d36/9d5f9740-e0c1-5784-a204-f48d380e3d36_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_10.jpg saved to cache
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d5f9740-e0c1-5784-a204-f48d380e3d36
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0508110>
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9850b3ac-1cc2-5902-9c4f-c19b91fbedbf/9850b3ac-1cc2-5902-9c4f-c19b91fbedbf_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-011.jpg saved to cache
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9850b3ac-1cc2-5902-9c4f-c19b91fbedbf
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1624ad0>
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b125e0-83e0-5438-bc48-281f0867ab56/e8b125e0-83e0-5438-bc48-281f0867ab56_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_3.jpg saved to cache
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8b125e0-83e0-5438-bc48-281f0867ab56
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0481710>
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9963dc62-2b0e-5036-9a4c-5267260b6641/9963dc62-2b0e-5036-9a4c-5267260b6641_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_ext_2.jpg saved to cache
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9963dc62-2b0e-5036-9a4c-5267260b6641
2026-04-22 13:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_2.jpg> (referer: None)
2026-04-22 13:13:50 [manheim.gb] INFO: Found listing with ID: 3002408
2026-04-22 13:13:50 [manheim.gb] INFO: Scrape type for 3002408: 1
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_5.jpg not downloaded yet
2026-04-22 13:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-009.jpg> (referer: None)
2026-04-22 13:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_4.jpg> (referer: None)
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_ext_2.jpg not downloaded yet
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_11.jpg not downloaded yet
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-007.jpg not downloaded yet
2026-04-22 13:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_ext_1.jpg> (referer: None)
2026-04-22 13:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_7.jpg> (referer: None)
2026-04-22 13:13:50 [manheim.gb] INFO: Found listing with ID: 3010348
2026-04-22 13:13:50 [manheim.gb] INFO: Scrape type for 3010348: 1
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_2.jpg not downloaded yet
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b050a050>
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79cb74b2-007c-5b35-8739-4707bfc22f73/79cb74b2-007c-5b35-8739-4707bfc22f73_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_ext_6.jpg saved to cache
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79cb74b2-007c-5b35-8739-4707bfc22f73
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03e1950>
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79cb74b2-007c-5b35-8739-4707bfc22f73/79cb74b2-007c-5b35-8739-4707bfc22f73_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_ext_7.jpg saved to cache
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79cb74b2-007c-5b35-8739-4707bfc22f73
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0415150>
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b125e0-83e0-5438-bc48-281f0867ab56/e8b125e0-83e0-5438-bc48-281f0867ab56_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_5.jpg saved to cache
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8b125e0-83e0-5438-bc48-281f0867ab56
2026-04-22 13:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_9.jpg> (referer: None)
2026-04-22 13:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_9.jpg> (referer: None)
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_10.jpg not downloaded yet
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-006.jpg not downloaded yet
2026-04-22 13:13:50 [manheim.gb] INFO: Found listing with ID: 3011010
2026-04-22 13:13:50 [manheim.gb] INFO: Scrape type for 3011010: 1
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_9.jpg not downloaded yet
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_9.jpg not downloaded yet
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-005.jpg not downloaded yet
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b03e3750>
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b125e0-83e0-5438-bc48-281f0867ab56/e8b125e0-83e0-5438-bc48-281f0867ab56_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_ext_2.jpg saved to cache
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8b125e0-83e0-5438-bc48-281f0867ab56
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b044eb90>
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9850b3ac-1cc2-5902-9c4f-c19b91fbedbf/9850b3ac-1cc2-5902-9c4f-c19b91fbedbf_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2909317-9999999-26083217-009.jpg saved to cache
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9850b3ac-1cc2-5902-9c4f-c19b91fbedbf
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0431710>
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d5f9740-e0c1-5784-a204-f48d380e3d36/9d5f9740-e0c1-5784-a204-f48d380e3d36_image_8.jpg HTTP/1.1" 201 0
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dca1a9cc-0536-46e7-a869-582fcd6e6e11_4.jpg saved to cache
2026-04-22 13:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d5f9740-e0c1-5784-a204-f48d380e3d36
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1030d50>
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79cb74b2-007c-5b35-8739-4707bfc22f73/79cb74b2-007c-5b35-8739-4707bfc22f73_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_ext_1.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79cb74b2-007c-5b35-8739-4707bfc22f73
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b04313d0>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d91c27-df92-538d-9c28-d248ce920f46/b6d91c27-df92-538d-9c28-d248ce920f46_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_7.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6d91c27-df92-538d-9c28-d248ce920f46
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_10.jpg> (referer: None)
2026-04-22 13:13:51 [manheim.gb] INFO: Found listing with ID: 3011281
2026-04-22 13:13:51 [manheim.gb] INFO: Scrape type for 3011281: 1
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_10.jpg not downloaded yet
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2936665-4167066-13.jpg> (referer: None)
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_4.jpg> (referer: None)
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_2.jpg not downloaded yet
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-003.jpg not downloaded yet
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_6.jpg> (referer: None)
2026-04-22 13:13:51 [manheim.gb] INFO: Found listing with ID: 3017371
2026-04-22 13:13:51 [manheim.gb] INFO: Scrape type for 3017371: 0
2026-04-22 13:13:51 [manheim.gb] INFO: Found listing with ID: 3018451
2026-04-22 13:13:51 [manheim.gb] INFO: Scrape type for 3018451: 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_11.jpg not downloaded yet
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1067790>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b125e0-83e0-5438-bc48-281f0867ab56/e8b125e0-83e0-5438-bc48-281f0867ab56_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_9.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8b125e0-83e0-5438-bc48-281f0867ab56
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16604d0>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9963dc62-2b0e-5036-9a4c-5267260b6641/9963dc62-2b0e-5036-9a4c-5267260b6641_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_9.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9963dc62-2b0e-5036-9a4c-5267260b6641
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_7.jpg> (referer: None)
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_1.jpg> (referer: None)
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-002.jpg not downloaded yet
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_11.jpg> (referer: None)
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_11.jpg> (referer: None)
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_4.jpg not downloaded yet
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-001.jpg not downloaded yet
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1687a10>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b125e0-83e0-5438-bc48-281f0867ab56/e8b125e0-83e0-5438-bc48-281f0867ab56_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_10.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8b125e0-83e0-5438-bc48-281f0867ab56
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16e2c90>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a00b9a75-bde4-50e7-b9c0-45d61486218f/a00b9a75-bde4-50e7-b9c0-45d61486218f_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936665-4167066-13.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a00b9a75-bde4-50e7-b9c0-45d61486218f
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b067a950>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79cb74b2-007c-5b35-8739-4707bfc22f73/79cb74b2-007c-5b35-8739-4707bfc22f73_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_4.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79cb74b2-007c-5b35-8739-4707bfc22f73
2026-04-22 13:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 445859e2-3c61-5588-8d87-49dca465c106 with identifier: 3002408
2026-04-22 13:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 445859e2-3c61-5588-8d87-49dca465c106 with scrape type 1
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 445859e2-3c61-5588-8d87-49dca465c106
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3002408-2813338-13.jpg not downloaded yet
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1662010>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d91c27-df92-538d-9c28-d248ce920f46/b6d91c27-df92-538d-9c28-d248ce920f46_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_6.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6d91c27-df92-538d-9c28-d248ce920f46
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-008.jpg not downloaded yet
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_ext_7.jpg not downloaded yet
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1685510>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a00b9a75-bde4-50e7-b9c0-45d61486218f/a00b9a75-bde4-50e7-b9c0-45d61486218f_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_7.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a00b9a75-bde4-50e7-b9c0-45d61486218f
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0528250>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d91c27-df92-538d-9c28-d248ce920f46/b6d91c27-df92-538d-9c28-d248ce920f46_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_1.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6d91c27-df92-538d-9c28-d248ce920f46
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b186ef50>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b125e0-83e0-5438-bc48-281f0867ab56/e8b125e0-83e0-5438-bc48-281f0867ab56_image_7.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_11.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8b125e0-83e0-5438-bc48-281f0867ab56
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06adb10>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79cb74b2-007c-5b35-8739-4707bfc22f73/79cb74b2-007c-5b35-8739-4707bfc22f73_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_11.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79cb74b2-007c-5b35-8739-4707bfc22f73
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_4.jpg> (referer: None)
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_11.jpg> (referer: None)
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_9.jpg> (referer: None)
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-004.jpg not downloaded yet
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_ext_4.jpg not downloaded yet
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_3.jpg> (referer: None)
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-010.jpg> (referer: None)
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-007.jpg> (referer: None)
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_5.jpg> (referer: None)
2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-009.jpg> (referer: None)
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_ext_3.jpg not downloaded yet
2026-04-22 13:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e26f27-1e14-539a-85de-de15a692ae36 with identifier: 3011281
2026-04-22 13:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e26f27-1e14-539a-85de-de15a692ae36 with scrape type 1
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 96e26f27-1e14-539a-85de-de15a692ae36
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-8.jpg not downloaded yet
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_ext_5.jpg not downloaded yet
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-13.jpg not downloaded yet
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_ext_2.jpg not downloaded yet
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-6.jpg not downloaded yet
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b052b250>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d91c27-df92-538d-9c28-d248ce920f46/b6d91c27-df92-538d-9c28-d248ce920f46_image_5.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_4.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6d91c27-df92-538d-9c28-d248ce920f46
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0758590>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d91c27-df92-538d-9c28-d248ce920f46/b6d91c27-df92-538d-9c28-d248ce920f46_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_11.jpg saved to cache
2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6d91c27-df92-538d-9c28-d248ce920f46
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fa0210>
2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a00b9a75-bde4-50e7-b9c0-45d61486218f/a00b9a75-bde4-50e7-b9c0-45d61486218f_image_6.jpg HTTP/1.1" 201 0
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_9.jpg saved to cache
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a00b9a75-bde4-50e7-b9c0-45d61486218f
2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_9.jpg not downloaded yet
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-4.jpg not downloaded yet
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_10.jpg not downloaded yet
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-3.jpg not downloaded yet
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b165b910>
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a00b9a75-bde4-50e7-b9c0-45d61486218f/a00b9a75-bde4-50e7-b9c0-45d61486218f_image_3.jpg HTTP/1.1" 201 0
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_3.jpg saved to cache
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a00b9a75-bde4-50e7-b9c0-45d61486218f
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1079490>
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdc228b-ee46-510c-b98a-2a3d2231e7cd/8bdc228b-ee46-510c-b98a-2a3d2231e7cd_image_0.jpg HTTP/1.1" 201 0
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-010.jpg saved to cache
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bdc228b-ee46-510c-b98a-2a3d2231e7cd
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fd8590>
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdc228b-ee46-510c-b98a-2a3d2231e7cd/8bdc228b-ee46-510c-b98a-2a3d2231e7cd_image_2.jpg HTTP/1.1" 201 0
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-007.jpg saved to cache
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bdc228b-ee46-510c-b98a-2a3d2231e7cd
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b107ea50>
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a00b9a75-bde4-50e7-b9c0-45d61486218f/a00b9a75-bde4-50e7-b9c0-45d61486218f_image_4.jpg HTTP/1.1" 201 0
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_5.jpg saved to cache
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a00b9a75-bde4-50e7-b9c0-45d61486218f
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2fab710>
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdc228b-ee46-510c-b98a-2a3d2231e7cd/8bdc228b-ee46-510c-b98a-2a3d2231e7cd_image_1.jpg HTTP/1.1" 201 0
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-009.jpg saved to cache
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bdc228b-ee46-510c-b98a-2a3d2231e7cd
2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_9.jpg> (referer: None)
2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_10.jpg> (referer: None)
2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_11.jpg> (referer: None)
2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-003.jpg> (referer: None)
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_11.jpg not downloaded yet
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-2.jpg not downloaded yet
2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_2.jpg> (referer: None)
2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-005.jpg> (referer: None)
2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-002.jpg> (referer: None)
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_4.jpg not downloaded yet
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-1.jpg not downloaded yet
2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3002408-2813338-13.jpg> (referer: None)
2026-04-22 13:13:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01761f91-ca15-565e-9492-92bd828959d0 with identifier: 3011010
2026-04-22 13:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01761f91-ca15-565e-9492-92bd828959d0 with scrape type 1
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 01761f91-ca15-565e-9492-92bd828959d0
2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 01761f91-ca15-565e-9492-92bd828959d0
2026-04-22 13:13:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 01761f91-ca15-565e-9492-92bd828959d0, identifier: 3011010
2026-04-22 13:13:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 01761f91-ca15-565e-9492-92bd828959d0 with identifier: 3011010
2026-04-22 13:13:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 01761f91-ca15-565e-9492-92bd828959d0 with identifier: 3011010