o 38i! @s.dZddlZddlmZmZmZmZddlmZej ddzddl Z Wne y4ddl m Z YnwGdd d Z ed kre Zd Zd Zed eedeeeeZedeD]ZededdedqaeeeZedeD]\ZZZededededdq~dSdS)ua Word Alignment Module ===================== BERT tabanlı kelime hizalama (simalign kullanarak) N)ListDictTupleOptional)tqdmz..)configc @seZdZdZddedefddZddZd ed ed eefd d Z  ddee eefde de d eeefddZ dd ed eded ee eeeffddZ dd ed ede d ee eeeffddZdS) WordAlignerui BERT tabanlı kelime hizalama sınıfı. simalign kütüphanesini wrapper olarak kullanır. N model_namedevicecCs0|ptj|_|ptjr dnd|_d|_d|_dS)u Args: model_name: BERT model adı (default: config'den) device: 'cpu' veya 'cuda' (default: config'den) cpucudaNF)rALIGNMENT_MODELr CPU_ONLYr aligner _initialized)selfr r r=/var/www/html/PEPCVSON/terminology-extractor/src/alignment.py__init__s  zWordAligner.__init__c Cs|jrdSz)ddlm}td|jtd|j||jddd|_d |_td WdSty:td tyM}ztd |d}~ww) uModeli yükle (lazy loading)Nr)SentenceAligneru🔄 Loading alignment model: z Device: bpemai)model token_typematching_methodsTu✅ Alignment model loadedu5❌ simalign not installed. Run: pip install simalignu$❌ Failed to load alignment model: ) rsimalignrprintr r r ImportError Exception)rrerrr initialize$s*  zWordAligner.initializesourcetargetreturnc Cs|js||r |s gSzK|}|}|r|s!gWS|j||}g}|d|dg}|D]\}} |t|krU| t|krU||| |||| ddq6|WSt ys} zt d| gWYd} ~ Sd} ~ ww)u@ Tek bir cümle çifti için kelime hizalaması yap. Args: source: İngilizce cümle target: Türkçe cümle Returns: List of alignments: [{'src_idx': 0, 'tgt_idx': 1, 'src_word': 'pump', 'tgt_word': 'pompa', 'score': 0.95}, ...] itermaxinterg?)src_idxtgt_idxsrc_wordtgt_wordscoreu⚠️ Alignment error: N) rr!stripsplitrget_word_alignsgetlenappendrr) rr"r# src_tokens tgt_tokens alignmentsresult align_pairsr'r(r rrralign_sentence_pair?s8    zWordAligner.align_sentence_pairTpairs batch_size show_progressc CsX|js||p tj}g}|rt|ddn|}|D]\}}|||}||q|S)uA Batch halinde cümle çiftlerini hizala. Args: pairs: List of (source, target) tuples batch_size: Batch boyutu (default: config'den) show_progress: Progress bar göster Returns: List of alignment results for each pair Aligning)desc)rr!r BATCH_SIZErr7r1) rr8r9r:resultsiteratorr"r#r4rrr align_batchrs    zWordAligner.align_batch min_scorecCsP|ptj}|||}g}|D]}|d|kr%||d|d|dfq|S)u' Hizalanmış terimleri çıkar. Args: source: İngilizce cümle target: Türkçe cümle min_score: Minimum skor (default: config'den) Returns: List of (source_term, target_term, score) tuples r+r)r*)rMIN_CONFIDENCEr7r1)rr"r#rAr4termsalignrrrextract_aligned_termss  z!WordAligner.extract_aligned_termsmax_phrase_lenc CsB|ptj}|||}|sgS|jdddg}g}g}g}d} d} |D]]} | d| dkrOt| d| dkrO|| d|| d || d n+|rkt||krk|d |d |t|t|f| dg}| d g}| d g}| d} | d} q%|rt||kr|d |d |t|t|f|S) uf Çok kelimeli ifadeleri (phrase) hizala. Ardışık hizalanmış kelimeleri grupla. Args: source: İngilizce cümle target: Türkçe cümle max_phrase_len: Maksimum kelime sayısı Returns: List of (source_phrase, target_phrase, avg_score) tuples cSs|dS)Nr'r)xrrrsz7WordAligner.extract_phrase_alignments..)keyr'r(r)r*r+ ) rMAX_TERM_WORDSr7sortabsr1r0joinsum) rr"r#rFr4phrases current_src current_tgtcurrent_scores last_src_idx last_tgt_idxrDrrrextract_phrase_alignmentssF      z%WordAligner.extract_phrase_alignments)NN)NT)N)__name__ __module__ __qualname____doc__strrr!rrr7rintboolr@floatrErXrrrrr s4 4     r __main__z"Check the hydraulic pump pressure.u)Hidrolik pompa basıncını kontrol edin.z Source: zTarget: z Word Alignments:z r)z -> r*z Phrase Alignments:z (score: z.2f))r\systypingrrrrrpathinsertrrr rYrr"r#rr7r4arXrRsrctgtr+rrrrs8   ]