:h]ddlddlddlddlddlmZmZmZddlm Z ddl m Z ddl m Z ddlmZddlmZddlmZmZdd lZdd lZdd lZdd lZdd lZdd lmZd d d d ad ZdZdZdZdZdZ dZ!dZ"dZ#dZ$dZ%dZ&dZ'dZ(dZ)dZ*dZ+dZ,d$dZ-d Z.d!Z/d"Z0e1d#k(rejde0y y )%)*)send_token_reportsend_telegram_alertsend_telegram_message)AsyncIOScheduler)BackgroundScheduler) CronTrigger)IntervalTrigger) DictCursor)datetime timedeltaN)webF) bonk_finished pump_finished last_resetcKdtd<dtd<tjjtd<tj dyw)z%Reset completion status for new batchFrrru*🔄 Reset completion status for new batchN)completion_statusr now isoformat token_loggerinfo:/home/ubuntu/SOL_API/sol_API/src/v2/utils/token_procces.pyreset_completion_statusrsG*/o&).o&&.lln&>&>&@l#BCsAAclK|dk(rdtd<tjdn=|dk(rdtd<tjdntjd|y tdrBtdr9tjd t d {t d {y77w) z%Mark a worker (bonk/pump) as finishedbonkTru"🟠 BONK worker reported finishedpumpru"🔵 PUMP worker reported finishedu❌ Unknown worker type: FuI🎉 Both BONK and PUMP workers finished! Triggering wallet processing...N)rrrerrortrigger_wallet_processingr) worker_types rmark_worker_finishedr"'sf-1/*>?  -1/*>?6{mDE).?.Pef')))%'''  *'s$BB4B0B4*B2+B42B4clKd}tjdd{ tdddd{tj4d{}|j |d4d{}|j dk(rR|jd{}tjd | dddd{dddd{y |jd{}tjd |j d | dddd{dddd{y 7777777r7[7'7#1d{7swYnxYwdddd{7y#1d{7swYyxYw#t$r$}tjd|d Yd}~y d}~wwxYww)z&Send start request to wallet processorzhttp://localhost:8083NzWallet Processing TriggereduQ🚀 Both BONK and PUMP workers have completed. Starting wallet processing now...SUCCESS/startu/🚀 Successfully triggered wallet processing: Tu)❌ Failed to trigger wallet processing: z - Fu(❌ Error triggering wallet processing: exc_info) asynciosleepraiohttp ClientSessionpoststatusjsonrrtextr Exception)wallet_processor_urlsessionresponseresult error_textes rr r >s2 -- ! ) _    ((* ! !g||';&>E/ F EFF4E&E'*E E/EE/! F,E-F1F45F8F:E/<E>E/FEE/FE EE E/ F(E+)F.F4/F5E8 6F=FF4F F1 F,'F4,F11F4cK |jd{}|jd}|stjddidSt |d{}|rtjd|t dStjdd idS7{7>#t $rF}tjd |d tjdt|id cYd}~Sd}~wwxYww)z8HTTP endpoint to receive worker completion notificationsNr!rzworker_type requiredi)r/received)r/r!rzInvalid worker_typeu1❌ Error handling worker finished notification: Tr(i) r0getr json_responser"rr2rrstr)requestdatar!successr8s rhandle_worker_finishedrAXs@\\^#hh}- $$g/E%FsS S,[99 $$$*%6&  $$g/D%EcR R$ : @NqcR]ab  '3q6!23??@snC)BB/BC)BB"B9C):BC)BB C& ;C!C&C)!C&&C)cfKtjttdxr tddSw)z0HTTP endpoint to check current completion statusrr)r both_finished)rr<r)r>s rhandle_completion_statusrDps5   .*?;b@QRa@b s/1c K tjdit}|jt}d}|j ||f|j }|rt|dnd |j|jS#t$r'}tjd|d|dYd}~nd}~wwxYw jjy#jjwxYww) Nz=SELECT processed FROM token_migrations WHERE token_hash = %s; processedFz)Error getting processed status for token : Tr(r) pymysqlconnect DB_CONFIGcursorr executefetchoneboolcloser2 db_loggerrtokenconnrKqueryr6r8s rget_token_as_processedrUws ++Z(Ouuh'",2tF;'(=   aCE7"QCP[_``a`     sADA$B )!D B:B50C5B::C>!D"DDcK tjdit}|jt}d}|j ||f|j }|r|dnd |j|jS#t$rG}tjd|d|dYd}~jjyd}~wwxYw#jjwxYww)Nz8SELECT pool FROM token_migrations WHERE token_hash = %s;poolzError getting pool for token rGTr(r) rHrIrJrKr rLrMrOr2rPrrQs rget_token_poolrXs ++Z(Juuh'"!'vf~T1   7wbDtT     sAC9AB !C9 C C 'C+!C9 CC"C66C9cK tjdit}|j}d}|j ||f|j jjy#t $r'}tjd|d|dYd}~Ld}~wwxYw#jjwxYww)Nz;UPDATE token_migrations SET good = 1 WHERE token_hash = %s;zError setting token as good rGTr(r rHrIrJrKrLcommitr2rPrrOrRrSrKrTr8s rset_token_as_goodr]s ++Muuh'    T6ugRsCdSST   ;C AA3!C 3 B#<BB&B##B&&"CC cK tjdit}|j}d}|j ||f|j jjy#t $r'}tjd|d|dYd}~Ld}~wwxYw#jjwxYww)Nz@UPDATE token_migrations SET processed = 1 WHERE token_hash = %s;z!Error setting token as processed rGTr(rrZr\s rset_token_as_processedr`s ++Ruuh'    Y;E7"QCHSWXXY   r^cK|syd}tj4d{}|d}|j|4d{}|jdk(r4|j d{}t j d|dn#t jd|jddddd{tjd d{|d }d |i}|j|| 4d{}|jdk7rDt jd |j dddd{dddd{y|j d{}t j d|dddddd{|d} |j| 4d{}|jdk7rDt jd|j dddd{dddd{y|j d{} t j d| ddddd{|d} |j| 4d{}|jdk7rDt jd|j dddd{dddd{y|j d{} t j d| ddddd{dt|dcdddd{S7777p#1d{7swYxYw7l7J7 777#1d{7swYxYw77z7m7W7/#1d{7swY@xYw7)7777#1d{7swYxYw7#1d{7swYyxYww)ui Отправляет список токенов в BONK воркер для обработки Nzhttp://localhost:8081r&r'u🟢 BONK worker started: r/u"⚠️ BONK worker start returned  (may already be running)? /fill_queuetokensr0u❌ Failed to fill BONK queue: ✅ Added countz tokens to BONK queue /save_queueu❌ Failed to save BONK queue: u💾 Saved BONK queue to file: file/start_processingu%❌ Failed to start BONK processing: u🚀 Started BONK processing: messager@r/ tokens_count r,r-r.r/r0rrwarningr*r+rlen rebase_urlr4 start_urlr5 start_datafill_urlpayload fill_datasave_url save_data process_url process_datas rsend_tokens_to_bonk_workerr} &H$$&*B*B'j' << * v vh#%#+==?2 !!$>z(?S>T"UV$$'I(//IZZs%tu  v vmmC   Z{+V$<<w<7 V V8#%""%DX__DU#VW V V#*B*B*B*'mmo-I    9W+=*>>ST U  V VZ{+<<) U UX#%""%DX__DU#VW U U5*B*B*B<'mmo-I    ? &@Q?RS T  U U" "34 << , Z Z#%""%J8??J[#\] Z ZG*B*B*BN"*0L    >|I?V>WX Y  Z Z$S[AU*B*B*B v2 v v v v !  V V#*B*.  V V V V U U5*B<.  U U U U Z ZG*BN1  Z Z Z ZG*B*B*B*BNOLON-LN-#L(&L"'AL(* N-5L%6N-L>$N-7M8N-;3M. N-9M:N-> O M OM"M # M N-M N--M&.N-13M5$ N-/M)0N-4 O?M,OM5M/M58 N-M2N-"N #N-&3N N-$N%N-) O4N5O:N NN- N-8N9N- ON+ON-"L(%N-(L; .L1/L; 6 N-N-N-O M N-M# MM#  N-)N-,O/M52N-5N ;M><N  N-N-ONN-N( NN( $N-+O-N?3N6 4N?;Oc6Kt|gd{S7w)zE Backwards compatibility - sends single token to BONK worker N)r}rRs rsend_token_to_bonk_workerr,UG4 44 4 cK|syd}tj4d{}|d}|j|4d{}|jdk(r4|j d{}t j d|dn#t jd|jddddd{tjd d{|d }d |i}|j|| 4d{}|jdk7rDt jd |j dddd{dddd{y|j d{}t j d|dddddd{|d} |j| 4d{}|jdk7rDt jd|j dddd{dddd{y|j d{} t j d| ddddd{|d} |j| 4d{}|jdk7rDt jd|j dddd{dddd{y|j d{} t j d| ddddd{dt|dcdddd{S7777p#1d{7swYxYw7l7J7 777#1d{7swYxYw77z7m7W7/#1d{7swY@xYw7)7777#1d{7swYxYw7#1d{7swYyxYww)ui Отправляет список токенов в PUMP воркер для обработки Nzhttp://localhost:8082r&r'u🟢 PUMP worker started: r/u"⚠️ PUMP worker start returned rbrcrdrerfu❌ Failed to fill PUMP queue: rgrhz tokens to PUMP queueriu❌ Failed to save PUMP queue: u💾 Saved PUMP queue to file: rjrku%❌ Failed to start PUMP processing: u🚀 Started PUMP processing: rlr@rmrorrs rsend_tokens_to_pump_workerrr~rc6Kt|gd{S7w)zE Backwards compatibility - sends single token to PUMP worker N)rrs rsend_token_to_pump_workerrrrcK|tjd|dy|jd}|stjd|dytj |t tj dt|dyw)u Обрабатывает ответ от воркера: - проверяет наличие валидных кошельков, - завершает обработку токена. Nu❌ No response from worker []walletsu🔥 Wallet list empty [u!🏁 Token process finished with z wallets)rrr; StaticMethod save_to_fileSESSION_WALLETS_FILErrq)rRr5rs rhandle_worker_responser&s :5'CDll9%G 5eWA>?g';<9#g,xPQsBB c>Ktjd|t|d{}|rtjd|dd|dSt |j d{}|rXt |d{t|d{tjd|d t|d{}d ||d St |d{tjd |d t|d{}d||d S77777W7@7w)u{ Функция обработки одного токена (предварительная фильтрация) zProcessing token: Nu ⚠️ Token z already processed!already_processed)r/rRru ✅ Token z is goodgood)r/rRrWu ❌ Token z is bad bad) rrrUrpFiltersfilter_token_by_candlesr`r]rX)rRrFproperrWs r process_tokenr;s*5'23,U33I}UG3FGH->>'??A AF $U+++&&&JugX67#E** 5$??$U+++JugX67#E**%>>!4 B+&* ,*s|'DDAD+D,DDDD+D?DDD+DD DDDDDDDc TKtd{g}g}d}d}d}d}d}d}d} d} d} |D]} | d} |dz }t| d{}|ddk(rg|dz }|ddk(r|j|d | dz } O|dd k(r|j|d |dz }q|dz }tj d | |dd k(r!|dz }|d}|dk(r| dz } |d k(s| dz } |dd k(s|dz }tj dtj d|tj d|tj d|tj d|tj d|tj dt |d| d| dtj dt |d|d| d|rStj dt |dt|d{}|rtj d|dd|rStj dt |dt|d{}|rtj d|ddt |t |||||||| | | d d!S77Y77Lw)"uN Обрабатывает токены батчами по пулам Nr token_hashr/rrWPUMPrRBONKu$🔥🔥🔥 Unknown pool for token rru📊 BATCH STATISTICS:z Total tokens processed:  ✅ Good tokens:  ❌ Bad tokens:  ⚠️ Already processed: u 🔥 Unknown pool: u 🔵 PUMP tokens:  (✅ good, ❌ bad)u 🟠 BONK tokens: zSending z tokens to PUMP workeru"✅ PUMP processing initiated for rnz tokensz tokens to BONK workeru"✅ BONK processing initiated for ) total_processed good_tokens bad_tokensr unknown_poolgood_bonk_tokensbad_bonk_tokensgood_pump_tokensbad_pump_tokens) pump_tokens bonk_tokens statistics) rrappendrrrrqrr})rerrrgood_tokens_countbad_tokens_countalready_processed_countunknown_pool_countgood_bonk_countbad_bonk_countgood_pump_countbad_pump_count token_datarRr6rW pump_response bonk_responses rprocess_tokens_batchrSsM " ###KKOONON) <(1$U++ ( v %  " f~'""6'?31$6)""6'?31$"a'"""%I%#QR H  &  ! &>Dv~!#!# H !4 4 #q ( #3)8.03O3DEF,->,?@A+,<+=>?56M5NOP./A.BCD-c+.>-?u_DUU_`n_ootuv-c+.>-?u_DUU_`n_ootuvHS%5$66LMN8EE     B=Q_C`Baahi jHS%5$66LMN8EE     B=Q_C`Baahi j;';'.,*!8. /- /-   M$.,HFFsUJ(J7J(J! BJ(J(.DJ(J$AJ(J&AJ(!J($J(&J(c>Kd}d} tjdit}|j}t j t dz jd}t j jd}tjd|d|dd}|j|||f|j}|D]>}|jD])\}}t|ts|j||<+@tt d d 5} t#j$|| d d dddtjdt'|d||r|j)|r|j)SS#1swYRxYw#tj*$rK} t,j/d| dgcYd} ~ |r|j)|r|j)SSd} ~ wwxYw#|r|j)|r|j)wwxYww)u; Возвращает список токенов Ndaysz%Y-%m-%d 00:00:00u!🕖Getting token list interval [z] - [rz SELECT token_hash, migration_started FROM token_migrations WHERE migration_started >= %s AND migration_started < %s wzutf-8)encodingF)indent ensure_asciizAdding z token to listz MySQL error: Tr(r)rHrIrJrKr rr strftimerrrLfetchallitems isinstanceropenTOKENS_JSON_FILEr0dumprqrOErrorrPr) rSrK start_dateend_daterTresultsrowkeyvalueferrs rget_token_list_from_DBrs D F%++llnya'88BBCVW <<>**+>?=j\xjXYZ[  uz845//# 1C!iik 1 UeX.$0CH 1 1 "C' : @a IIgq ? @ GCL>@A  LLN  JJL  @ @ ==-u-=  LLN  JJL    LLN  JJL seHC)F2)FF5+F &HF FG0%G+G0G3&H+G00G33'HHc Ktdd{td{}|stjdytjdt |dt |d{}|j di}tjdtjd|j d d tjd |j d d tjd |j dd tjd|j dd tjd|dd|j dd d|j dd dtjd|dd|j dd d|j dd dt|d{|j d d }|j d d }|j dd }|j dd }|j dd }|j dd }|d kDr(||z dz} tjd| dd|d |d!||z} ||z} | d kDr(|| z dz} tjd"| dd|d | d!| d kDr(|| z dz} tjd#| dd|d | d!|S777h7 w)$NrrzNo tokens found for processingz Processing z tokens in batch moderu 🏁 BATCH PROCESSING COMPLETED:u 📈 Total tokens: rrrrrrrru 🔵 PUMP tokens sent: rrrrrru 🟠 BONK tokens sent: rrrdu 📊 Overall success rate: z.1fz% (/)u 🔵 PUMP success rate: u 🟠 BONK success rate: ) bonk_migratedrrrrqrr;r)rer6statstotalr good_pumpbad_pump good_bonkbad_bonk success_rate total_pump total_bonkpump_success_ratebonk_success_rates rtoken_processing_jobrs^ Q )+ +F :; CK=0EFG'/ /F JJ|R (E8:.uyy9JA/N.OPQ,UYY}a-H,IJK+EIIlA,F+GHI5eii@SUV6W5XYZ26-3H2IuyyYkmnOoNppz|A|E|EFWYZ|[{\\abc26-3H2IuyyYkmnOoNppz|A|E|EFWYZ|[{\\abc E """ II' +E 99]A &D ,a0Iyy*A.H ,a0Iyy*A.H qyu + :<:LCPTvUVW\V]]^_`X%JX%JA~&3s:78I#7NcR[Q\\]^h]iijklA~&3s:78I#7NcR[Q\\]^h]iijkl M] + 0#sFKKKKA K1K2EKKDKKKKcKtjd td{tjdtdddd{|re|j d}|r<|j }tjd|t d|d d{ytjd yy77n7 #t$r6}tjd |d dl }|jYd}~yd}~wwxYww) Nu🔁 Job startedu🔁 Job completedzToken Processing Job Completedu=✅ Scheduled token processing job has finished successfully.r%ru📅 Next scheduled run: u<📅 Next Token Processing ⏰ Scheduled for: zI The next batch of tokens will be processed automatically.u.⚠️ Main job not found for next run loggingu🔁 Job failed with error: r) rrrrget_job next_run_timerrpr2 traceback print_exc) schedulermain_jobnext_runr8rs r scheduled_jobr s()"$$$./" , K      (()?@H#11!!$=hZ"HI,008z:WX $$%UV  %  8<=soD CB=)CB?AC C!C%D&C;D=C?CC D ,C=8D=DDcKtj}|jjdt|jj dt |Sw)z9Create web application for receiving worker notificationsz/worker_finishedz/completion_status)r Applicationrouteradd_postrAadd_getrD)apps rcreate_web_appr/sC // CJJ*,BCJJ+-EF JsAAcKtd{}tj|}|jd{tj|dd}|j d{t jdy7v7K7w)z!Start the coordination web serverNz0.0.0.0iu3🌐 Token coordination server running on port 8084)rr AppRunnersetupTCPSitestartrr)rrunnersites rstart_web_serverr6sk C ]]3 F ,,. ;;vy$ /D **,KL !s1B B,B B .B ,B -B  B  B c <Ktd{ttjdfd}tjd}|j t dddddd }t jd |t jd |jtjj|td || djjd}t jd|jfd}j|tdd tj j#d{y7\7#t$$rt'dj)YywxYww)Nz Europe/Warsaw)timezonec8Ktd{y7wN)r)rsr job_wrapperzmain..job_wrapperFsI&&&s i rzOriginal start_date: zIn UTC: r)rrrr)idu6📅 Scheduler started. Next token processing run at: cKjd}|r%|j}tjd|ytj dyw)Nru6💓 Scheduler heartbeat - Next token processing job: u+⚠️ Main token processing job not found!)rrrrrp)rrrs r heartbeatzmain..heartbeatYsM$$%;< --H    VW_V`a b  !N OsAA)minutes heartbeat_jobu🛑 Shutting down scheduler...)rrpytzrlocalizer rr astimezoneUTCadd_jobr rrrr*EventwaitKeyboardInterruptprintshutdown)r warsaw_tzrrr rs @rmainr?sj   $--*HII' o.I##HT1b"b!$DEJ-j\:;!6!6txx!@ ABC Q: J ! OO  !78HNxOeOeNfghP#  mmo""$$$ON %  /0sFFE-D/F%E2'E0(E2,F0E22$FFFF__main__r)3 utils.config utils.logger utils.filtersutils.bonk_migrationsutils.telegram_notifierrrrapscheduler.schedulers.asyncior!apscheduler.schedulers.backgroundrapscheduler.triggers.cronr apscheduler.triggers.intervalr pymysql.cursorsr r r r,r*timer0r rrrr"r rArDrUrXr]r`r}rrrrrrrrrrrr__name__runrrrr&s#aa;A19&(  D.4@0    3Bj5 3Bj5R*?0Yv+\/b DM,\ zGKKr