o 38i% @spdZddlZddlmZmZmZmZmZddlm Z ej ddzddl Z Wne y6ddlm Z YnwGdd d Zed kreZd Zd Zed eeedZedeD]Zededdeddeddq\eedZedeD]ZededdeddqeedZedeD] ZedeqeedZededSdS)z] Term Extractor Module ===================== spaCy ile POS tagging ve Noun Phrase extraction N)ListDictTupleSetOptional) defaultdictz..)configc @seZdZdZddedefddZddZdd ed ed eefd dZ dd ed ed eefddZ dd ed ede d eefddZ deededed eefddZ dd ed ed eee ffddZdS) TermExtractorui spaCy tabanlı terim çıkarma sınıfı. Noun Phrase'leri ve teknik terimleri tespit eder. Nen_modeltr_modelcCs.|ptj|_|p tj|_d|_d|_d|_dS)uy Args: en_model: İngilizce spaCy model adı tr_model: Türkçe spaCy model adı NF)r SPACY_EN_MODEL en_model_nameSPACY_TR_MODEL tr_model_namenlp_ennlp_tr _initialized)selfr r rB/var/www/html/PEPCVSON/terminology-extractor/src/term_extractor.py__init__s   zTermExtractor.__init__c Cs|jrdSddl}ztd|j||j|_tdWn ty>td|jd|j|j||j|_Ynwztd|j ||j |_ tdWn'ty{td z|d |_ Wntyxtd |j|_ YnwYnwd |_dS) u'spaCy modellerini yükle (lazy loading)Nru"🔄 Loading spaCy English model: u✅ English model loadedu$⚠️ Model not found. Downloading z...u"🔄 Loading spaCy Turkish model: u✅ Turkish model loadedu4⚠️ Model not found. Trying multilingual model...xx_ent_wiki_smu9⚠️ Using English model for Turkish (limited accuracy)T) rspacyprintrloadrOSErrorclidownloadrr)rrrrr initialize%s6       zTermExtractor.initializeentextlangreturnc Cs~|js||dkr|jn|j}||}g}|jD]"}t|j}|tj kr)q| |j|j j|j j |j |j|dq|S)u Metinden Noun Phrase'leri çıkar. Args: text: İşlenecek metin lang: Dil ('en' veya 'tr') Returns: List of noun phrases with metadata r )r!rootroot_posstartend word_count)rrrr noun_chunkslenr!splitr MAX_TERM_WORDSappendr$pos_r&r')rr!r"nlpdocphraseschunkr(rrrextract_noun_phrasesFs$     z"TermExtractor.extract_noun_phrasescCs|js||dkr|jn|j}||}g}|D]1}|jtjvrJ|jtj vr*q|jtj vr3qt |jtj krz8TermExtractor.extract_compound_terms..cs$|] }|tjvp |tjvVqdSNr r9r:rFrrr   z7TermExtractor.extract_compound_terms..cSrDrrErFrrrrIrJcsrKrLrMrFrrrrNrO) rrr r,rrr.r7r-r!r*joinall) rr!r"rAr/r0 compoundscurrent_compoundr? compound_text words_lowerrrrextract_compound_termss:      z$TermExtractor.extract_compound_terms alignments source_text target_textc Cs|js|||}dd|D}||}dd|D}g}|D]8} | dd} | dd} || d} | tjvr[| tjvr[| tj vr[| | d<|| d| d <| | q#|S) u? Hizalanmış terimleri POS tag'e göre filtrele. Sadece NOUN, ADJ içerenleri tut. Args: alignments: Word alignment sonuçları source_text: Kaynak metin target_text: Hedef metin Returns: Filtered alignments cSi|] }|j|jqSrr!r8r.rGr?rrr z/TermExtractor.filter_by_pos..cSrZrr[r\rrrr]r^src_wordtgt_wordXsrc_postgt_pos) rrrrgetr8r r7r9r:r-) rrWrXrYdoc_enrcdoc_trrdfilteredalignr_rasrc_tagrrr filter_by_poss&       zTermExtractor.filter_by_poscCsV|js||dkr|jn|j}||}tt}|D] }||jd7<qt|S)u Metindeki POS dağılımını hesapla. Args: text: İşlenecek metin lang: Dil Returns: POS tag counts r rB)rrrrrintr.dict)rr!r"r/r0 distributionr?rrrget_pos_distributions z"TermExtractor.get_pos_distribution)NN)r )r N)__name__ __module__ __qualname____doc__strrrrrr3r@rlrVrkrorrrrr s* !%)  3 $+r __main__z?Check the hydraulic pump pressure and replace the safety valve.uIHidrolik pompa basıncını kontrol edin ve emniyet valfini değiştirin.z English: r z Noun Phrases:z r!z (root: r$z, POS: r%)z Technical Terms:z (r5z Compound Terms:z POS Distribution: ) rssystypingrrrrr collectionsrpathinsertr ImportErrorr`r rp extractortext_entext_trrr3npsnpr@r>trVrRcrodistrrrrs@   y *