• LogParser v0.8.2, last updated at 2026-04-22 13:14:31, http://scrapyd-0:6800/logs/sourcing_v2/manheim.gb/2026-04-22T13_10_41.json

PROJECT (sourcing_v2), SPIDER (manheim.gb)

Click to refresh Realtime version
  • Log analysis
  • Log categorization
  • Progress visualization
  • View log
  • projectsourcing_v2
    spidermanheim.gb
    job2026-04-22T13_10_41
    first_log_time2026-04-22 13:10:46
    latest_log_time2026-04-22 13:13:52
    runtime0:03:06
    crawled_pages 238
    scraped_items 117
    shutdown_reasonN/A
    finish_reasonN/A
    log_critical_count0
    log_error_count267
    log_warning_count1
    log_redirect_count0
    log_retry_count0
    log_ignore_count0
    latest_crawl
    latest_scrape
    latest_log
    current_time
    latest_itemN/A
    • WARNING+

    • error_logs
      last 10 of 267

      2026-04-22 13:13:47 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id fad9baf3-07c3-595e-bcdf-c355fe3108ac: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
       | Status Code: 500
       | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
       | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:46 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
      
      2026-04-22 13:13:47 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      Traceback (most recent call last):
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
          response.raise_for_status()
        File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
          raise HTTPError(http_error_msg, response=self)
      requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-04-22 13:13:47 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
       'c_o_2_emission_value': None,
       'car_expert_report_source_url': None,
       'city': 'Plymouth - In Transit',
       'color': 'ORANGE',
       'currency': 'GBP',
       'engine': '0.0L',
       'expiration_date': None,
       'fuel_type': 'Electric',
       'id': 'fad9baf3-07c3-595e-bcdf-c355fe3108ac',
       'is_damaged': False,
       'is_operable': True,
       'is_vat_deductible': False,
       'is_vat_included': False,
       'latitude': None,
       'license_plate': 'WM70ZFR',
       'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/HATCHBACK?id=2907243',
       'listing': 'auction',
       'location': 'Plymouth - In Transit',
       'longitude': None,
       'make': 'VAUXHALL',
       'model': 'HATCHBACK',
       'odometer': None,
       'odometer_reading_unit': 'mi',
       'origin_country_code': 'GB',
       'original_photo_count': 0,
       'postal_code': None,
       'price': 0,
       'price_includes_vat': False,
       'region': None,
       'registration_date': '2021-01-27',
       'seller_name': None,
       'title': 'VAUXHALL HATCHBACK 100kW Elite Nav 50kWh 5dr Auto [7.4kWCh]',
       'transmission': 'automatic',
       'trim': '100kW Elite Nav 50kWh 5dr Auto [7.4kWCh]',
       'year': 2021}
      Traceback (most recent call last):
        File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
          current.result = callback(  # type: ignore[misc]
        File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
          return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
          raise e
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
          response.raise_for_status()
        File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
          raise HTTPError(http_error_msg, response=self)
      requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-04-22 13:13:47 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 2b34a58e-dd54-593f-a5ff-b5194e398def: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
       | Status Code: 500
       | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
       | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:47 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
      
      2026-04-22 13:13:47 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      Traceback (most recent call last):
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
          response.raise_for_status()
        File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
          raise HTTPError(http_error_msg, response=self)
      requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-04-22 13:13:47 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
       'c_o_2_emission_value': None,
       'car_expert_report_source_url': None,
       'city': 'Manchester - In Transit',
       'color': 'BLACK',
       'currency': 'GBP',
       'engine': '1.6L',
       'expiration_date': None,
       'fuel_type': 'Petrol',
       'id': '2b34a58e-dd54-593f-a5ff-b5194e398def',
       'is_damaged': False,
       'is_operable': True,
       'is_vat_deductible': False,
       'is_vat_included': False,
       'latitude': None,
       'license_plate': 'DP68CXJ',
       'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=2906755',
       'listing': 'auction',
       'location': 'Manchester - In Transit',
       'longitude': None,
       'make': 'VAUXHALL',
       'model': 'ASTRA',
       'odometer': None,
       'odometer_reading_unit': 'mi',
       'origin_country_code': 'GB',
       'original_photo_count': 0,
       'postal_code': None,
       'price': 0,
       'price_includes_vat': False,
       'region': None,
       'registration_date': '2018-12-31',
       'seller_name': None,
       'title': 'VAUXHALL ASTRA 1.6T 16V 200 Elite Nav 5dr',
       'transmission': 'manual',
       'trim': '1.6T 16V 200 Elite Nav 5dr',
       'year': 2018}
      Traceback (most recent call last):
        File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
          current.result = callback(  # type: ignore[misc]
        File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
          return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
          raise e
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
          response.raise_for_status()
        File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
          raise HTTPError(http_error_msg, response=self)
      requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-04-22 13:13:48 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id feec5448-3621-5126-8ab1-50a58c2b5a26: Failed to post item to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
       | Status Code: 500
       | Response Content: {"type":"https://tools.ietf.org/html/rfc9110#section-15.6.1","title":"Internal Server Error","status":500,"detail":"An unexpected error occurred while saving changes."}
       | Response Headers: {'Content-Type': 'application/json; charset=utf-8', 'Date': 'Wed, 22 Apr 2026 13:13:48 GMT', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
      
      2026-04-22 13:13:48 [crawlers.pipelines.post_to_api] ERROR: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      Traceback (most recent call last):
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
          response.raise_for_status()
        File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
          raise HTTPError(http_error_msg, response=self)
      requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-04-22 13:13:48 [scrapy.core.scraper] ERROR: Error processing {'auction_title': '',
       'c_o_2_emission_value': None,
       'car_expert_report_source_url': None,
       'city': 'Leeds - In Transit',
       'color': 'NERA BLACK',
       'currency': 'GBP',
       'engine': '1.2L',
       'expiration_date': None,
       'fuel_type': 'Petrol',
       'id': 'feec5448-3621-5126-8ab1-50a58c2b5a26',
       'is_damaged': False,
       'is_operable': True,
       'is_vat_deductible': False,
       'is_vat_included': False,
       'latitude': None,
       'license_plate': 'KV70ZTR',
       'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/308?id=2926097',
       'listing': 'auction',
       'location': 'Leeds - In Transit',
       'longitude': None,
       'make': 'PEUGEOT',
       'model': '308',
       'odometer': None,
       'odometer_reading_unit': 'mi',
       'origin_country_code': 'GB',
       'original_photo_count': 0,
       'postal_code': None,
       'price': 0,
       'price_includes_vat': False,
       'region': None,
       'registration_date': '2020-09-18',
       'seller_name': None,
       'title': 'PEUGEOT 308 1.2 PureTech 130 Allure 5dr [Digital i-Cockpit]',
       'transmission': 'manual',
       'trim': '1.2 PureTech 130 Allure 5dr [Digital i-Cockpit]',
       'year': 2020}
      Traceback (most recent call last):
        File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
          current.result = callback(  # type: ignore[misc]
        File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
          return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
          raise e
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
          response.raise_for_status()
        File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
          raise HTTPError(http_error_msg, response=self)
      requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-04-22 13:13:48 [manheim.gb] ERROR: Error extracting listing 2983733: Field transmission is not nullable
    • warning_logs
      1 in total

      2026-04-22 13:10:46 [common.geocoding.geonames_geocoder] WARNING: GeoNames data directory not found: /usr/src/app/common/geocoding/data. Geocoding will not be available. Run download_geonames.py first.

      INFO

      DEBUG

    • scrapy_version

      2.11.2
    • telnet_console

      127.0.0.1:6023
    • telnet_password

      913abd40632aabc5
    • latest_crawl

      2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3002408-2813338-13.jpg> (referer: None)
    • latest_scrape

      2026-04-22 13:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/search/vehiclebeautyimages/>
    • latest_stat

      2026-04-22 13:13:47 [scrapy.extensions.logstats] INFO: Crawled 238 pages (at 93 pages/min), scraped 117 items (at 47 items/min)
    • Head

      2026-04-22 13:10:46 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
      2026-04-22 13:10:46 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
      2026-04-22 13:10:46 [manheim.gb] INFO: Starting spider manheim.gb
      2026-04-22 13:10:46 [scrapy.addons] INFO: Enabled addons:
      []
      2026-04-22 13:10:46 [asyncio] DEBUG: Using selector: EpollSelector
      2026-04-22 13:10:46 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
      2026-04-22 13:10:46 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
      2026-04-22 13:10:46 [scrapy.extensions.telnet] INFO: Telnet Password: 913abd40632aabc5
      2026-04-22 13:10:46 [scrapy.middleware] INFO: Enabled extensions:
      ['scrapy.extensions.corestats.CoreStats',
       'scrapy.extensions.telnet.TelnetConsole',
       'scrapy.extensions.memusage.MemoryUsage',
       'scrapy.extensions.feedexport.FeedExporter',
       'scrapy.extensions.logstats.LogStats',
       'scrapy.extensions.closespider.CloseSpider']
      2026-04-22 13:10:46 [scrapy.crawler] INFO: Overridden settings:
      {'BOT_NAME': 'SourcingV2',
       'CLOSESPIDER_TIMEOUT': 7200,
       'DOWNLOAD_MAXSIZE': 52428800,
       'DOWNLOAD_WARNSIZE': 10485760,
       'FEED_EXPORT_ENCODING': 'utf-8',
       'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/manheim.gb/2026-04-22T13_10_41.log',
       'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
       'MEMUSAGE_LIMIT_MB': 2048,
       'MEMUSAGE_WARNING_MB': 1536,
       'NEWSPIDER_MODULE': 'spiders',
       'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
       'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
       'SPIDER_MODULES': ['spiders', 'auth_check'],
       'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
       'USER_AGENT': ''}
      2026-04-22 13:10:46 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
      2026-04-22 13:10:46 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
      2026-04-22 13:10:46 [scrapy.middleware] INFO: Enabled downloader middlewares:
      ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
       'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
       'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
       'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
       'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
       'scrapy.downloadermiddlewares.retry.RetryMiddleware',
       'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
       'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
       'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
       'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
       'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
       'scrapy.downloadermiddlewares.stats.DownloaderStats']
      2026-04-22 13:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
      2026-04-22 13:10:46 [scrapy.middleware] INFO: Enabled spider middlewares:
      ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
       'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
       'scrapy.spidermiddlewares.referer.RefererMiddleware',
       'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
       'scrapy.spidermiddlewares.depth.DepthMiddleware',
       'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
       'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
       'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
      2026-04-22 13:10:46 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
      2026-04-22 13:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
      2026-04-22 13:10:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2099
      2026-04-22 13:10:46 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
      2026-04-22 13:10:46 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
      2026-04-22 13:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
      2026-04-22 13:10:46 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
      2026-04-22 13:10:46 [common.geocoding.geonames_geocoder] WARNING: GeoNames data directory not found: /usr/src/app/common/geocoding/data. Geocoding will not be available. Run download_geonames.py first.
      2026-04-22 13:10:46 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-04-22 13:10:46 [scrapy.middleware] INFO: Enabled item pipelines:
      ['crawlers.pipelines.translation_pipeline.TranslationPipeline',
       'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
       'crawlers.pipelines.geocoding_pipeline.GeocodingPipeline',
       'crawlers.pipelines.post_to_api.PostToApiPipeline']
      2026-04-22 13:10:46 [scrapy.core.engine] INFO: Spider opened
      2026-04-22 13:10:46 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
      2026-04-22 13:10:46 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
      2026-04-22 13:10:46 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
      2026-04-22 13:10:46 [scrapy-playwright] INFO: Starting download handler
      2026-04-22 13:10:46 [scrapy-playwright] INFO: Starting download handler
      2026-04-22 13:10:51 [scrapy-playwright] INFO: Launching browser firefox
      2026-04-22 13:10:52 [scrapy-playwright] INFO: Browser firefox launched
      2026-04-22 13:10:52 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
      2026-04-22 13:10:53 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
    • Tail

      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1067790>
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b125e0-83e0-5438-bc48-281f0867ab56/e8b125e0-83e0-5438-bc48-281f0867ab56_image_5.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_9.jpg saved to cache
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8b125e0-83e0-5438-bc48-281f0867ab56
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16604d0>
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9963dc62-2b0e-5036-9a4c-5267260b6641/9963dc62-2b0e-5036-9a4c-5267260b6641_image_6.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5a38d2e0-1766-4f1b-a5c2-b90ad3ecbcf4_9.jpg saved to cache
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9963dc62-2b0e-5036-9a4c-5267260b6641
      2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_7.jpg> (referer: None)
      2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_1.jpg> (referer: None)
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-002.jpg not downloaded yet
      2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_11.jpg> (referer: None)
      2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_11.jpg> (referer: None)
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_4.jpg not downloaded yet
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-001.jpg not downloaded yet
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1687a10>
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b125e0-83e0-5438-bc48-281f0867ab56/e8b125e0-83e0-5438-bc48-281f0867ab56_image_6.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_10.jpg saved to cache
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8b125e0-83e0-5438-bc48-281f0867ab56
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b16e2c90>
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a00b9a75-bde4-50e7-b9c0-45d61486218f/a00b9a75-bde4-50e7-b9c0-45d61486218f_image_0.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936665-4167066-13.jpg saved to cache
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a00b9a75-bde4-50e7-b9c0-45d61486218f
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b067a950>
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79cb74b2-007c-5b35-8739-4707bfc22f73/79cb74b2-007c-5b35-8739-4707bfc22f73_image_5.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_4.jpg saved to cache
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79cb74b2-007c-5b35-8739-4707bfc22f73
      2026-04-22 13:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 445859e2-3c61-5588-8d87-49dca465c106 with identifier: 3002408
      2026-04-22 13:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 445859e2-3c61-5588-8d87-49dca465c106 with scrape type 1
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 445859e2-3c61-5588-8d87-49dca465c106
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3002408-2813338-13.jpg not downloaded yet
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1662010>
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d91c27-df92-538d-9c28-d248ce920f46/b6d91c27-df92-538d-9c28-d248ce920f46_image_2.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_6.jpg saved to cache
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6d91c27-df92-538d-9c28-d248ce920f46
      2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-008.jpg not downloaded yet
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_ext_7.jpg not downloaded yet
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1685510>
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a00b9a75-bde4-50e7-b9c0-45d61486218f/a00b9a75-bde4-50e7-b9c0-45d61486218f_image_1.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_7.jpg saved to cache
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a00b9a75-bde4-50e7-b9c0-45d61486218f
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0528250>
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d91c27-df92-538d-9c28-d248ce920f46/b6d91c27-df92-538d-9c28-d248ce920f46_image_3.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_1.jpg saved to cache
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6d91c27-df92-538d-9c28-d248ce920f46
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b186ef50>
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b125e0-83e0-5438-bc48-281f0867ab56/e8b125e0-83e0-5438-bc48-281f0867ab56_image_7.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/22022ec3-52cf-4721-9237-f4dff93f4720_11.jpg saved to cache
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8b125e0-83e0-5438-bc48-281f0867ab56
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b06adb10>
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79cb74b2-007c-5b35-8739-4707bfc22f73/79cb74b2-007c-5b35-8739-4707bfc22f73_image_6.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8fa4b163-0a11-4e4f-a22c-2ef3ac954333_11.jpg saved to cache
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79cb74b2-007c-5b35-8739-4707bfc22f73
      2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_4.jpg> (referer: None)
      2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_11.jpg> (referer: None)
      2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_9.jpg> (referer: None)
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-004.jpg not downloaded yet
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_ext_4.jpg not downloaded yet
      2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_3.jpg> (referer: None)
      2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-010.jpg> (referer: None)
      2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-007.jpg> (referer: None)
      2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_5.jpg> (referer: None)
      2026-04-22 13:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-009.jpg> (referer: None)
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_ext_3.jpg not downloaded yet
      2026-04-22 13:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e26f27-1e14-539a-85de-de15a692ae36 with identifier: 3011281
      2026-04-22 13:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e26f27-1e14-539a-85de-de15a692ae36 with scrape type 1
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 96e26f27-1e14-539a-85de-de15a692ae36
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-8.jpg not downloaded yet
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_ext_5.jpg not downloaded yet
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-13.jpg not downloaded yet
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_ext_2.jpg not downloaded yet
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-6.jpg not downloaded yet
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b052b250>
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d91c27-df92-538d-9c28-d248ce920f46/b6d91c27-df92-538d-9c28-d248ce920f46_image_5.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_4.jpg saved to cache
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6d91c27-df92-538d-9c28-d248ce920f46
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0758590>
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d91c27-df92-538d-9c28-d248ce920f46/b6d91c27-df92-538d-9c28-d248ce920f46_image_6.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_11.jpg saved to cache
      2026-04-22 13:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6d91c27-df92-538d-9c28-d248ce920f46
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fa0210>
      2026-04-22 13:13:51 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a00b9a75-bde4-50e7-b9c0-45d61486218f/a00b9a75-bde4-50e7-b9c0-45d61486218f_image_6.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_9.jpg saved to cache
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a00b9a75-bde4-50e7-b9c0-45d61486218f
      2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/vehiclebeautyimages/> (referer: https://www.manheim.co.uk/search)
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_9.jpg not downloaded yet
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-4.jpg not downloaded yet
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_10.jpg not downloaded yet
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-3.jpg not downloaded yet
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b165b910>
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a00b9a75-bde4-50e7-b9c0-45d61486218f/a00b9a75-bde4-50e7-b9c0-45d61486218f_image_3.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_3.jpg saved to cache
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a00b9a75-bde4-50e7-b9c0-45d61486218f
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b1079490>
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdc228b-ee46-510c-b98a-2a3d2231e7cd/8bdc228b-ee46-510c-b98a-2a3d2231e7cd_image_0.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-010.jpg saved to cache
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bdc228b-ee46-510c-b98a-2a3d2231e7cd
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b0fd8590>
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdc228b-ee46-510c-b98a-2a3d2231e7cd/8bdc228b-ee46-510c-b98a-2a3d2231e7cd_image_2.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-007.jpg saved to cache
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bdc228b-ee46-510c-b98a-2a3d2231e7cd
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b107ea50>
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a00b9a75-bde4-50e7-b9c0-45d61486218f/a00b9a75-bde4-50e7-b9c0-45d61486218f_image_4.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_ext_5.jpg saved to cache
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a00b9a75-bde4-50e7-b9c0-45d61486218f
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63b2fab710>
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Creating container if not exists
      2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-04-22 13:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-04-22 13:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdc228b-ee46-510c-b98a-2a3d2231e7cd/8bdc228b-ee46-510c-b98a-2a3d2231e7cd_image_1.jpg HTTP/1.1" 201 0
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-009.jpg saved to cache
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bdc228b-ee46-510c-b98a-2a3d2231e7cd
      2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_9.jpg> (referer: None)
      2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_10.jpg> (referer: None)
      2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/134963e2-1b03-4b7f-9a32-97172ab174f5_11.jpg> (referer: None)
      2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-003.jpg> (referer: None)
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_11.jpg not downloaded yet
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-2.jpg not downloaded yet
      2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8da0f0b7-26cd-41cb-9004-a1af9be9171d_ext_2.jpg> (referer: None)
      2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-005.jpg> (referer: None)
      2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2971032-9999999-94105806-002.jpg> (referer: None)
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2fef45da-2c78-4d38-92de-48809a280453_4.jpg not downloaded yet
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3011281-4138512-1.jpg not downloaded yet
      2026-04-22 13:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3002408-2813338-13.jpg> (referer: None)
      2026-04-22 13:13:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01761f91-ca15-565e-9492-92bd828959d0 with identifier: 3011010
      2026-04-22 13:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01761f91-ca15-565e-9492-92bd828959d0 with scrape type 1
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 01761f91-ca15-565e-9492-92bd828959d0
      2026-04-22 13:13:52 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 01761f91-ca15-565e-9492-92bd828959d0
      2026-04-22 13:13:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 01761f91-ca15-565e-9492-92bd828959d0, identifier: 3011010
      2026-04-22 13:13:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 01761f91-ca15-565e-9492-92bd828959d0 with identifier: 3011010
    • Log

      /1/log/utf8/sourcing_v2/manheim.gb/2026-04-22T13_10_41/

    • Source

      http://scrapyd-0:6800/logs/sourcing_v2/manheim.gb/2026-04-22T13_10_41.log