Bugfix release 1.2.0
Installation instructions:
https://github.com/certtools/intelmq/blob/1.1.2/docs/INSTALL.md
Upgrade instructions:
https://github.com/certtools/intelmq/blob/1.1.2/docs/UPGRADING.md
Core
intelmq.lib.bot
:Bot.__handle_sighup
: Handle exceptions inshutdown
method of bots.
Harmonization
- FQDN: Disallow
:
in FQDN values to prevent values like '10.0.0.1:8080' (#1235).
Bots
Collectors
intelmq.bots.collectors.stomp.collector
- Fix name of shutdown method, was ineffective in the past.
- Ignore
NotConnectedException
errors on disconnect during shutdown.
intelmq.bots.collectors.mail.collector_mail_url
: Decode body if it is bytes (#1367).intelmq.bots.collectors.tcp.collector
: Timeout added. More stable version.
Parsers
intelmq.bots.parsers.shadowserver
:intelmq.bots.parsers.microsoft.parser_ctip
:- Workaround for mis-formatted data in
networkdestinationipv4
field (since 2019-03-14). - Ignore "hostname" ("destination.fqdn") if it contains invalid data.
- Workaround for mis-formatted data in
intelmq.bots.parsers.shodan.parser
:- In
minimal_mode
:- Fix the parsing, previously only
source.geolocation.cc
andextra.shodan
was correctly filled with information. - Add a
classification.type
= 'other' to all events. - Added tests for this mode.
- Fix the parsing, previously only
- Normal mode:
- Fix the parsing of
timestamp
to `time.source in the normal mode, previously no timezone information has been added and thus every event raised an exception. - ISAKMP: Ignore
isakmp.aggressive
, as the content is same asisakmp
or less.
- Fix the parsing of
- In
intelmq.bots.parsers.abusech.parser_ip
: Re-structure the bot and support new format of the changed "Feodo Tracker Domains" feed.intelmq.bots.parsers.n6.parser
:- Add parsing for fields "confidence", "expires" and "source".
- Add support for type "bl-other" (category "other").
Experts
intelmq.bots.experts.sieve.expert
: Fix key definition to allow field names with numbers (malware.hash.md5
/sha1
, #1371).
Outputs
intelmq.bots.outputs.tcp.output
: Timeout added. When no separator used, awaits that every message is acknowledged by a simple "Ok" string to ensure more stability.
Documentation
- Install: Update operating system versions
- Sieve Expert: Fix
elsif
->elif
. - Rephrase the description of
time.*
fields. - Feeds: New URL and format of the "Feodo Tracker IPs" feed. "Feodo Tracker Domains" has been discontinued.
Packaging
Tests
- Add missing
__init__.py
files in 4 bot's test directories. Previously these tests have never been executed. intelmq.lib.test
: Allow bot test class names with an arbitrary postfix separated by an underscore. E.g.TestShodanParserBot_minimal
.
Tools
- intelmqctl:
- status: Show commandline differences if a program with the expected PID could be found, but they do not match (previous output was
None
). - Use logging level from defauls configuration if possible, otherwise intelmq's internal default. Previously, DEBUG was used unconditionally.
- status: Show commandline differences if a program with the expected PID could be found, but they do not match (previous output was