Page 2 of 3

Re: OpenEFA Installer v2.11 Now Available - Minimal Ubuntu Compatible

Posted: Sun Oct 19, 2025 6:09 pm
by Woger
Thanks for the extensive explanation. I am really getting excited about the end product :P

Re: OpenEFA Installer v1.x Now Available - Minimal Ubuntu Compatible

Posted: Mon Oct 20, 2025 5:24 pm
by MauriceW67
I just did a fresh install of version 1.5.6 and unfortunately I still have to report the same issues that I already mentioned before:
  • When sending a mail from another machine on the local network, the mail arrives in my Exchange mailbox, but the mail body is completely lost.
  • Mail sent locally is not added to the dashboard, presumably because it is marked as "bypassed" by SpaCy.
  • I sent a test mail from GMail and it was added to the dashboard and marked as spam with a score of 12.5 like before. However, marking the message as safe and releasing it does not work. The mail is marked with a new spam score of -5.0, but the release part does not work and the mail never arrives in my Exchange mailbox.

Re: OpenEFA Installer v1.x Now Available - Minimal Ubuntu Compatible

Posted: Mon Oct 20, 2025 6:45 pm
by Carl Brunning
yes i see the same problem so it been look at right now
a new version with fix be out soon

Re: OpenEFA Installer v1.x Now Available - Minimal Ubuntu Compatible

Posted: Tue Oct 21, 2025 7:07 am
by Woger
I just did a fresh install of 1.5.7.7 after the upgrade went wrong. Now I can't login anymore in the dashboard and mails are not coming through. Errors are the same as I posted yesterday on github, but I am not sure what the best place is to post the errors.

EDIT:
I put in port 26 for the relay server but that seems not to be working. After manually adding 26 to the transport file, mail goes out again but are just ndlr's.
And all logs are thrown in the syslog, which makes it almost unreadable.
This is from the spacyweb.log:
2025-10-21 08:59:10,733 - werkzeug - INFO - 84.29.166.32 - - [21/Oct/2025 08:59:10] "GET /auth/login HTTP/1.1" 200 -
2025-10-21 08:59:10,811 - werkzeug - INFO - 84.29.166.32 - - [21/Oct/2025 08:59:10] "GET /static/openefa-theme.css HTTP/1.1" 304 -
2025-10-21 08:59:19,027 - flask_wtf.csrf - INFO - The CSRF session token is missing.
2025-10-21 08:59:19,028 - werkzeug - INFO - 84.29.166.32 - - [21/Oct/2025 08:59:19] "POST /auth/login HTTP/1.1" 400 -

And from db_processor.log:
2025-10-21 09:18:31,883 - INFO - 📧 Processing email_data keys: ['message', 'message_id', 'from_header', 'recipients', 'text_content', 'timestamp', 'content_summary']
2025-10-21 09:18:31,883 - ERROR - ❌ Database insert error: cannot access local variable 're' where it is not associated with a value
2025-10-21 09:18:31,884 - ERROR - Queue data: {'version': '1.0', 'email_data': {'message': 'Retur....... etc.
2025-10-21 09:18:31,884 - ERROR - Traceback (most recent call last):
File "/opt/spacyserver/services/db_processor.py", line 221, in process_production_email_data
from_match = re.search(r'^From:\s*(.+)$', message_str, re.MULTILINE | re.IGNORECASE)
^^
UnboundLocalError: cannot access local variable 're' where it is not associated with a value

2025-10-21 09:18:31,884 - ERROR - ❌ Failed to process production email data

Re: OpenEFA Installer v1.x Now Available - Minimal Ubuntu Compatible

Posted: Tue Oct 21, 2025 6:06 pm
by Carl Brunning
do the fresh install again as i have tested and it all working now
yes they been a few bug got in, but they gone now,

Re: OpenEFA Installer v1.x Now Available - Minimal Ubuntu Compatible

Posted: Tue Oct 21, 2025 6:56 pm
by MauriceW67
Carl Brunning wrote: Tue Oct 21, 2025 6:06 pm do the fresh install again as i have tested and it all working now
yes they been a few bug got in, but they gone now,
Can you tell us how you're testing exactly? Because I did a fresh install again of version 1.5.7.10 just now and:
  • Still cannot send local mails properly, the body is still lost.
  • Still cannot release a message.
Can you tell me which log to check to see what's going wrong?

My current EFA 5 works just fine in the same setup (an Exchange 2019 server hosting the mailboxes and receiving the mails).

Re: OpenEFA Installer v1.x Now Available - Minimal Ubuntu Compatible

Posted: Tue Oct 21, 2025 7:15 pm
by Carl Brunning
my testing is using the same version you said
i just said release on the email that got stop it went to my email server with no problem.
the email server is a zimbra, as right now not change the efa5 to exchange yet.

be doing that another week when am happy with openefa

just thought you could try telnet from the spam server to you exchange see if that work
seem to remember exchange sometime block ip when it not the one for email

Re: OpenEFA Installer v1.x Now Available - Minimal Ubuntu Compatible

Posted: Tue Oct 21, 2025 9:39 pm
by MauriceW67
Using telnet from the OpenEFA server to the Exchange server works just fine.

Also, I already know OpenEFA can talk to Exchange, because when I send a mail locally using PowerShell, it arrives in Exchange, albeit without the mail body.

So something else must be going wrong when I try to release a message that was initially marked as spam.

Re: OpenEFA Installer v1.x Now Available - Minimal Ubuntu Compatible

Posted: Wed Oct 22, 2025 11:37 am
by Woger
Ok,
After last install the dashboard is working again. The testmail is also there. Sending a mail from outside through the openefa server got the mail disappear. Adding :26 after the domains in transport makes received mails bounce. All I get then is a non delivery report which show:
Diagnostic-Code: x-unix; ⚠️ Notification service not available: No module
named 'notification_service' ✅ Redis libraries loaded ✅ Real
authentication libraries loaded ✅ Loaded 18 trusted domains from
/opt/spacyserver/config/trusted_domains.json ✅ Loaded 2 processed domains
from database domain1.net -> x.x.x.x:25 domain2.com ->
x.x.x.x:25 ✅ Loaded relay config: x.x.x.x:26 ✅ Redis
queue connected ✅ Module otp_detector loaded ✅ Module entity_extraction
loaded ✅ Module email_dns loaded ✅ Module email_phishing loaded ✅
Module email_sentiment loaded ✅ Module email_language loaded ✅ Module
email_obfuscation loaded ✅ Module marketing_spam_filter loaded with 2
functions DEBUG: Warning: Typosquatting detector not available ✅ Module
bec_detector loaded ✅ Module enhanced_analysis loaded with 3 functions
✅ Module toad_detector loaded ✅ Module pdf_analyzer loaded ❌ Module
html_attachment_analyzer load error: name 'BeautifulSoup' is not defined
✅ Module fraud_funding_detector loaded ✅ Module url_reputation loaded
✅ Module behavioral_baseline loaded ✅ Module rbl_checker loaded ✅
Module antivirus_scanner loaded [13:18:31] === EMAIL FILTER WITH TIMEOUT
HANDLING START === ✅ Blocking database initialized ✅ GeoIP database
loaded ✅ Redis cache connected WARNING:email_dns:SPF lookup failed for
domain2.com: The DNS response does not contain an answer to the question:
domain2.com. IN TXT WARNING:email_dns:DMARC lookup failed for domain2.com: The DNS
query name does not exist: _dmarc.domain2.com. DNS Analysis: reputation=0,
trusted=True, spoofing=False, spam_score=0.00
INFO:email_sentiment:Sentiment analysis: neutral (polarity: 0.000) DEBUG:
Language detection: en (0.50) via default INFO:toad_detector:TOAD analysis
complete: risk_score=0.0, detected=False INFO:modules.module_access:🔗
DEBUG: Connecting to check modules for domain2.com
INFO:modules.module_access:🔍 DEBUG: Executing query for domain2.com
INFO:modules.module_access:📊 DEBUG: Found 0 modules for domain2.com: ()
INFO:modules.module_access:📦 Final modules for domain2.com: {'basic_ner':
True, 'email_storage': True, 'basic_search': True, 'compliance_tracking':
False, 'debt_monitoring': False, 'legal_alerts': False, 'payment_tracking':
False, 'advanced_analytics': False} INFO:antivirus_scanner:Successfully
connected to ClamAV daemon [13:19:03] ❌ Failed to relay to
x.x.x.x:25 for domain2.com: timed out [13:19:03] ❌ Some relay
operations failed PDF analysis libraries not available: No module named
'cv2' HTML analysis libraries not available: No module named 'bs4' Install
with: pip install beautifulsoup4 lxml

So it's still looking for port 25 (I put port 26 at installation). I don't know where this port is configured. DB?

In the logs I still see these errors:
2025-10-22T13:18:31.204862+02:00 s3 mariadbd[32385]: 2025-10-22 13:18:31 123 [Warning] Aborted connection 123 to db: 'spacy_email_db' user: 'spacy_user' host: 'localhost' (Got an error reading communication packets)
2025-10-22T13:18:31.211009+02:00 s3 mariadbd[32385]: 2025-10-22 13:18:31 122 [Warning] Aborted connection 122 to db: 'spacy_email_db' user: 'spacy_user' host: 'localhost' (Got an error reading communication packets)

and

2025-10-22T13:18:33.724610+02:00 s3 spacy-db-processor[36380]: 2025-10-22 13:18:33,724 - ERROR - Traceback (most recent call last):
2025-10-22T13:18:33.724659+02:00 s3 spacy-db-processor[36380]: File "/opt/spacyserver/services/db_processor.py", line 221, in process_production_email_data
2025-10-22T13:18:33.724676+02:00 s3 spacy-db-processor[36380]: from_match = re.search(r'^From:\s*(.+)$', message_str, re.MULTILINE | re.IGNORECASE)
2025-10-22T13:18:33.724690+02:00 s3 spacy-db-processor[36380]: ^^
2025-10-22T13:18:33.724738+02:00 s3 spacy-db-processor[36380]: UnboundLocalError: cannot access local variable 're' where it is not associated with a value
2025-10-22T13:18:33.724837+02:00 s3 spacy-db-processor[36380]: 2025-10-22 13:18:33,724 - ERROR - ❌ Failed to process production email data

Re: OpenEFA Installer v1.x Now Available - Minimal Ubuntu Compatible

Posted: Wed Oct 22, 2025 11:48 am
by Carl Brunning
not sure but what you got in /opt/spacyserver/config/email_filter_config.json
and may be check some of the other in there