VisionCareerMiniapp/vision-career
2
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Increase batch size for vacancies collecting task
All checks were successful
release / docker (push) Successful in 35s
Details

Browse Source
This commit is contained in:
estromenko 2025-11-03 15:52:27 +03:00
parent 92c1d97727
commit c5cba30997
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vacancies/main/management/commands/collect_vacancies_from_telegram_messages.py
View File

@ -49,7 +49,7 @@ class Command(BaseCommand):
exist_points_set = tuple(set(exist_points_ids)) exist_points_set = tuple(set(exist_points_ids))
result_rows = clickhouse_client.query(query, parameters={"exist_points": exist_points_set}).result_rows result_rows = clickhouse_client.query(query, parameters={"exist_points": exist_points_set}).result_rows
batch_size = 10 batch_size = 30
with ThreadPoolExecutor(max_workers=batch_size) as pool: with ThreadPoolExecutor(max_workers=batch_size) as pool:
pool.map(self._process_batch, batched(result_rows, batch_size)) pool.map(self._process_batch, batched(result_rows, batch_size))