Head
2026-05-13 09:23:13 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-05-13 09:23:13 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-05-13 09:23:13 [bca_logged_out.fr] INFO: Starting spider bca_logged_out.fr
2026-05-13 09:23:13 [scrapy.addons] INFO: Enabled addons:
[]
2026-05-13 09:23:13 [asyncio] DEBUG: Using selector: EpollSelector
2026-05-13 09:23:13 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-05-13 09:23:13 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-05-13 09:23:13 [scrapy.extensions.telnet] INFO: Telnet Password: 6badbff87ed4815e
2026-05-13 09:23:14 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-05-13 09:23:14 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/bca_logged_out.fr/2026-05-13T09_23_11.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-05-13 09:23:14 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-05-13 09:23:14 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-05-13 09:23:14 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-05-13 09:23:14 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-05-13 09:23:14 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-05-13 09:23:14 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-05-13 09:23:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-05-13 09:23:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2093
2026-05-13 09:23:14 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-05-13 09:23:14 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: fr
2026-05-13 09:23:14 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-05-13 09:23:14 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-05-13 09:23:16 [common.geocoding.geonames_geocoder] INFO: GeoNames geocoder loaded: 9 files, 94519 postal codes, 171568 cities
2026-05-13 09:23:16 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.alx.dev-cluster.alx.tech/api/sourcing/internal/listings
2026-05-13 09:23:16 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.geocoding_pipeline.GeocodingPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-05-13 09:23:16 [scrapy.core.engine] INFO: Spider opened
2026-05-13 09:23:16 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-05-13 09:23:16 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-05-13 09:23:16 [scrapy.extensions.memusage] INFO: Peak memory usage is 339MiB
2026-05-13 09:23:16 [scrapy-playwright] INFO: Starting download handler
2026-05-13 09:23:16 [scrapy-playwright] INFO: Starting download handler
2026-05-13 09:23:16 [scrapy-playwright] INFO: Launching 1 startup context(s)
2026-05-13 09:23:16 [scrapy-playwright] INFO: Launching browser firefox
2026-05-13 09:23:16 [scrapy-playwright] INFO: Launching 1 startup context(s)
2026-05-13 09:23:16 [scrapy-playwright] INFO: Launching browser firefox
Tail
'price_includes_vat': True,
'province': 'Haute-Garonne',
'province_code': 'FR-31',
'region': 'Occitanie',
'region_code': 'FR-76',
'registration_date': '2023-05-15',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 2008 0.0 PURETECH 130 CV, 2023',
'transmission': 'manual',
'trim': '0.0 PURETECH 130 CV',
'vin': 'VR3USHNSSPJ669799',
'year': 2023}
2026-05-13 09:26:25 [bca_logged_out.fr] INFO: Saving data for 65ba3e48-6109-4a80-b01c-80c2c27daf74: {'created_time': 1778664385.45648, 'last_price_update_time': 1778664385.456494, 'has_photos': True, 'auction_closing_time': 1924984800.0}
2026-05-13 09:26:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GR-093-GG/712570680> (referer: https://www.bcautoencheres.fr/Lot?id=23578565&ItemId=efdfc820-710a-4fef-bf53-072243e7852e&q=&bq=%7Csalecountry_exact%3AFR&sort=SaleDate&missingMileage=True&awaitingAppraisal=True&page=3&extraFiltersActive=true&returnTo=GR-093-GG&promoAppliedSets=&R=15&SR=10&SourceSystem=PEEP)
2026-05-13 09:26:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GR-093-GG/712570547> (referer: https://www.bcautoencheres.fr/Lot?id=23578565&ItemId=efdfc820-710a-4fef-bf53-072243e7852e&q=&bq=%7Csalecountry_exact%3AFR&sort=SaleDate&missingMileage=True&awaitingAppraisal=True&page=3&extraFiltersActive=true&returnTo=GR-093-GG&promoAppliedSets=&R=15&SR=10&SourceSystem=PEEP)
2026-05-13 09:26:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GR-093-GG/712570633> (referer: https://www.bcautoencheres.fr/Lot?id=23578565&ItemId=efdfc820-710a-4fef-bf53-072243e7852e&q=&bq=%7Csalecountry_exact%3AFR&sort=SaleDate&missingMileage=True&awaitingAppraisal=True&page=3&extraFiltersActive=true&returnTo=GR-093-GG&promoAppliedSets=&R=15&SR=10&SourceSystem=PEEP)
2026-05-13 09:26:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.bcautoencheres.fr/buyer/facetedsearch/GetViewModel?bq=%7Csalecountry_exact:FR&page=5&sort=SaleDate&missingMileage=true> (referer: https://www.bcautoencheres.fr/Search?bq=salecountry_exact:FR&page=5&sort=SaleDate&missingMileage=True) ['zyte-api']
2026-05-13 09:26:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592697> (referer: https://www.bcautoencheres.fr/Lot?id=23578592&ItemId=731689e5-d204-4682-9f3e-fb471e6d91cf&q=&bq=%7Csalecountry_exact%3AFR&sort=SaleDate&missingMileage=True&awaitingAppraisal=True&page=3&extraFiltersActive=true&returnTo=GX-611-GY&promoAppliedSets=&R=15&SR=10&SourceSystem=PEEP)
2026-05-13 09:26:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GR-093-GG/712570643> (referer: https://www.bcautoencheres.fr/Lot?id=23578565&ItemId=efdfc820-710a-4fef-bf53-072243e7852e&q=&bq=%7Csalecountry_exact%3AFR&sort=SaleDate&missingMileage=True&awaitingAppraisal=True&page=3&extraFiltersActive=true&returnTo=GR-093-GG&promoAppliedSets=&R=15&SR=10&SourceSystem=PEEP)
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd35c5e7990>
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-05-13 09:26:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-05-13 09:26:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c51c2a5-e24f-5b55-889a-97065df8ed96/9c51c2a5-e24f-5b55-889a-97065df8ed96_image_1.jpg HTTP/1.1" 201 0
2026-05-13 09:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592713 saved to cache
2026-05-13 09:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c51c2a5-e24f-5b55-889a-97065df8ed96
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd35c6ab010>
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-05-13 09:26:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-05-13 09:26:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd/362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd_image_5.jpg HTTP/1.1" 201 0
2026-05-13 09:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GR-093-GG/712570658 saved to cache
2026-05-13 09:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd
2026-05-13 09:26:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GR-093-GG/712570667> (referer: https://www.bcautoencheres.fr/Lot?id=23578565&ItemId=efdfc820-710a-4fef-bf53-072243e7852e&q=&bq=%7Csalecountry_exact%3AFR&sort=SaleDate&missingMileage=True&awaitingAppraisal=True&page=3&extraFiltersActive=true&returnTo=GR-093-GG&promoAppliedSets=&R=15&SR=10&SourceSystem=PEEP)
2026-05-13 09:26:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GR-093-GG/712570614> from <GET https://www1.bcaimage.com/GetDoc.aspx?DocType=VehicleImage&docId=712570614>
2026-05-13 09:26:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GR-093-GG/712570688> from <GET https://www1.bcaimage.com/GetDoc.aspx?DocType=VehicleImage&docId=712570688>
2026-05-13 09:26:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GR-093-GG/712570621> (referer: https://www.bcautoencheres.fr/Lot?id=23578565&ItemId=efdfc820-710a-4fef-bf53-072243e7852e&q=&bq=%7Csalecountry_exact%3AFR&sort=SaleDate&missingMileage=True&awaitingAppraisal=True&page=3&extraFiltersActive=true&returnTo=GR-093-GG&promoAppliedSets=&R=15&SR=10&SourceSystem=PEEP)
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd35c2692d0>
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-05-13 09:26:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-05-13 09:26:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd/362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd_image_4.jpg HTTP/1.1" 201 0
2026-05-13 09:26:25 [scrapy.crawler] INFO: Received SIGTERM twice, forcing unclean shutdown
2026-05-13 09:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GR-093-GG/712570680 saved to cache
2026-05-13 09:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd35c31f9d0>
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-05-13 09:26:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-05-13 09:26:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd/362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd_image_8.jpg HTTP/1.1" 201 0
2026-05-13 09:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GR-093-GG/712570547 saved to cache
2026-05-13 09:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd35c653550>
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-05-13 09:26:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-05-13 09:26:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd/362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd_image_7.jpg HTTP/1.1" 201 0
2026-05-13 09:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GR-093-GG/712570633 saved to cache
2026-05-13 09:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd
2026-05-13 09:26:25 [bca_logged_out.fr] INFO: IsUserAnonymous: True
2026-05-13 09:26:25 [bca_logged_out.fr] INFO: https://www.bcautoencheres.fr/buyer/facetedsearch/GetViewModel?bq=|salecountry_exact:FR&page=6&sort=SaleDate&missingMileage=true
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd35c700e90>
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-05-13 09:26:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-05-13 09:26:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c51c2a5-e24f-5b55-889a-97065df8ed96/9c51c2a5-e24f-5b55-889a-97065df8ed96_image_0.jpg HTTP/1.1" 201 0
2026-05-13 09:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592697 saved to cache
2026-05-13 09:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c51c2a5-e24f-5b55-889a-97065df8ed96
2026-05-13 09:26:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c51c2a5-e24f-5b55-889a-97065df8ed96, skipping ID generation
2026-05-13 09:26:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c51c2a5-e24f-5b55-889a-97065df8ed96 with scrape type 1
2026-05-13 09:26:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c51c2a5-e24f-5b55-889a-97065df8ed96 sending to next pipeline
2026-05-13 09:26:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca_logged_out.fr, Processed item id: 9c51c2a5-e24f-5b55-889a-97065df8ed96, identifier: 731689e5-d204-4682-9f3e-fb471e6d91cf
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd35c30acd0>
2026-05-13 09:26:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-05-13 09:26:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-05-13 09:26:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-05-13 09:26:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd/362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd_image_3.jpg HTTP/1.1" 201 0
2026-05-13 09:26:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GR-093-GG/712570643 saved to cache
2026-05-13 09:26:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 362b5131-dbdf-52ad-b5c5-19f8ed6ca2dd
2026-05-13 09:26:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca_logged_out.fr, Translating item: 9c51c2a5-e24f-5b55-889a-97065df8ed96 with identifier: 731689e5-d204-4682-9f3e-fb471e6d91cf
2026-05-13 09:26:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca_logged_out.fr, Applying rules to item: 9c51c2a5-e24f-5b55-889a-97065df8ed96 with identifier: 731689e5-d204-4682-9f3e-fb471e6d91cf
2026-05-13 09:26:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision result=miss country=FR postcode_present=False
2026-05-13 09:26:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca_logged_out.fr, Posting item: 9c51c2a5-e24f-5b55-889a-97065df8ed96 with identifier: 731689e5-d204-4682-9f3e-fb471e6d91cf to the API
2026-05-13 09:26:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-05-13 09:26:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/sourcing/internal/listings HTTP/1.1" 204 0
2026-05-13 09:26:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592697>
{'auction_title': "Véhicules d'occasion Hertz 24/03/2025 Internet - France (TT "
"CAR TRANSIT CDG), Véhicules d'occasion Hertz 24/03/2025, "
"Fin: 31/12 23:00 Véhicules d'occasion Hertz",
'car_expert_report_source_url': None,
'category': 'Non communiqué',
'city': 'CDG',
'color': 'White',
'currency': 'EUR',
'doors_number': 0,
'engine': '0.0L',
'engine_horse_power': None,
'expiration_date': '2030-12-31T22:00:00Z',
'fuel_type': 'Not disclosed',
'id': '9c51c2a5-e24f-5b55-889a-97065df8ed96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'license_plate': 'GX-611-GY',
'link_to_web_offer': 'https://www.bcautoencheres.fr/Lot?id=23578592&ItemId=731689e5-d204-4682-9f3e-fb471e6d91cf&q=&bq=%7Csalecountry_exact%3AFR&sort=SaleDate&missingMileage=True&awaitingAppraisal=True&page=3&extraFiltersActive=true&returnTo=GX-611-GY&promoAppliedSets=&R=15&SR=10&SourceSystem=PEEP',
'listing': 'directbuy',
'location': 'TT CAR TRANSIT CDG',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '208',
'odometer': 60400,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c51c2a5-e24f-5b55-889a-97065df8ed96/9c51c2a5-e24f-5b55-889a-97065df8ed96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476702,
'Height': 1440,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592697',
'Width': 1920},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c51c2a5-e24f-5b55-889a-97065df8ed96/9c51c2a5-e24f-5b55-889a-97065df8ed96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339163,
'Height': 1440,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592713',
'Width': 1920},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c51c2a5-e24f-5b55-889a-97065df8ed96/9c51c2a5-e24f-5b55-889a-97065df8ed96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292223,
'Height': 1440,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592701',
'Width': 1920},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c51c2a5-e24f-5b55-889a-97065df8ed96/9c51c2a5-e24f-5b55-889a-97065df8ed96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317394,
'Height': 1440,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592707',
'Width': 1920},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c51c2a5-e24f-5b55-889a-97065df8ed96/9c51c2a5-e24f-5b55-889a-97065df8ed96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408601,
'Height': 1440,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592718',
'Width': 1920},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c51c2a5-e24f-5b55-889a-97065df8ed96/9c51c2a5-e24f-5b55-889a-97065df8ed96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187194,
'Height': 1440,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592696',
'Width': 1920},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c51c2a5-e24f-5b55-889a-97065df8ed96/9c51c2a5-e24f-5b55-889a-97065df8ed96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275680,
'Height': 1440,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592722',
'Width': 1920},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c51c2a5-e24f-5b55-889a-97065df8ed96/9c51c2a5-e24f-5b55-889a-97065df8ed96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156698,
'Height': 1440,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592695',
'Width': 1920},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c51c2a5-e24f-5b55-889a-97065df8ed96/9c51c2a5-e24f-5b55-889a-97065df8ed96_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404931,
'Height': 1440,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592675',
'Width': 1920},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c51c2a5-e24f-5b55-889a-97065df8ed96/9c51c2a5-e24f-5b55-889a-97065df8ed96_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304033,
'Height': 1440,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/FR/GX-611-GY/707592678',
'Width': 1920}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2024-06-03',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 208 0.0 -, 2024',
'transmission': 'manual',
'trim': '0.0 -',
'vin': 'VR3UPHNEKR5015086',
'year': 2024}