forked from MISP/PyMISP
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathCHANGELOG.txt
4261 lines (3504 loc) · 138 KB
/
CHANGELOG.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Changelog
=========
v2.4.151 (2021-11-19)
---------------------
New
~~~
- Add Blind Carbon Copy (bcc) headers. [Sami Tainio]
Changes
~~~~~~~
- Bump version. [Raphaël Vinot]
- Bump misp-objects. [Raphaël Vinot]
- [feed-generator] Make the feature to exlude attribute type more
generic. [Sami Mokaddem]
- [feed-generator] Added exclude malware samples option. [Sami Mokaddem]
- Bump deps, chardet is required by pyfaup. [Raphaël Vinot]
- Removed a whitespace. [Sami Tainio]
- Keep strict and generate attributes when needed. [Raphaël Vinot]
- Slight changes regarding timezones. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Unified constructors. [Thomas Dupuy]
- Slight changes regarding timezones. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- [types] remove the duplicate. [Alexandre Dulaunoy]
- [describeTypes] remove duplicate filename-pattern. [Alexandre
Dulaunoy]
- [misp-objects] updated. [Alexandre Dulaunoy]
- [misp-objects] updated to the latest version. [Alexandre Dulaunoy]
- Bump many dependencies. [Raphaël Vinot]
- Add in test case for get_sharing_group and validate orgs are present.
[Tom King]
- Improve sharing groups, bring back organsations included and ability
to get specific SG. [Tom King]
- Add in test case for searching against orgs and users. [Tom King]
- Add ability to search against orgs and users by freetext search (both)
or organisation (users) [Tom King]
- [test] Check if all category types exists. [Jakub Onderka]
- Bump changelog. [Raphaël Vinot]
- [py] Typo. [Steve Clement]
- [describeTypes] updated to include ssh-fingerprint. [Alexandre
Dulaunoy]
Fix
~~~
- [feed-generator] Revert back the event initial search to use the index
endpoint instead of RestSearch. [Sami Mokaddem]
Relying on RestSearch was offering more flexibility than index in terms of filtering options,
however, it might introduce a significant overhead potentially leading to timeout.
- PyMISP.get_user_setting method. [Jakub Onderka]
- [tests] Remove debug prints. [Jakub Onderka]
- Fix final nosetest. [Tom King]
- Fix nosetests. [Tom King]
- [types] Update types to use `filename-pattern` type. [Jakub Onderka]
- [test] Remove debug print. [Jakub Onderka]
- [test] Correct error messages for blocked event. [Jakub Onderka]
- Missing import in __init__ [Raphaël Vinot]
Fix #796
- [tests] Fixed stix test. [chrisr3d]
- [py] Typo. [Steve Clement]
Other
~~~~~
- Update README.md. [Raphaël Vinot]
v2.4.148.1 (2021-09-30)
-----------------------
New
~~~
- Add few keys to email object creator. [Raphaël Vinot]
Fix #787
- Test cases for edit objects and upload stix. [Raphaël Vinot]
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump misp-objects. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- [doc] Minor fixes, note and typo. [Steve Clement]
- Bump deps. [Raphaël Vinot]
- [misp-objects] updated to the latest version. [Alexandre Dulaunoy]
- [misp-objects] updated to the latest version. [Alexandre Dulaunoy]
- Update tutorial for custom objects. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump live tests. [Raphaël Vinot]
- [misp-objects] updated to the latest version. [Alexandre Dulaunoy]
- [types] updated types/categories mapping. [Christophe Vandeplas]
- Remove test files. [Raphaël Vinot]
- Automatically pull the malwares repo when running
tests/testlive_comprehensive.py. [Raphaël Vinot]
- Remove submodules with malware. [Raphaël Vinot]
- Add test for updating a objects from a custom template. [Raphaël
Vinot]
- Re-bump changelog. [Raphaël Vinot]
Fix
~~~
- Message_from_bytes really dislikes newline at the beginning of a mail.
[Raphaël Vinot]
- Skip IPs in Received header. [Raphaël Vinot]
- Name is passed to super. [Raphaël Vinot]
- Do not create empty manifest, json load dislikes it. [Raphaël Vinot]
- Initial round of cleanup on redis feed generator. [Raphaël Vinot]
- Upload of STIX document with non-ascii characters. [Raphaël Vinot]
Due to: https://github.com/psf/requests/issues/5560
TL;DR: a variable of type str passed to data in a POST request will be
silently re-encoded to ISO-8859-1, making MISP barf on the other side.
- Remove outdated deps from setup.py. [Raphaël Vinot]
Fix https://github.com/MISP/MISP/issues/7729
Other
~~~~~
- Remove unicode to ascii parts. [Sami Tainio]
- Fix #787 and add Unicode to ASCII function. [Sami Tainio]
Fix #787
- Uses regex to pick up the hostnames/domains from the "Received: from" headers.
Unicode to ASCII function
- Spam messages more often than not contain junk text as unicode characters in the headers. The "from" and "subject" headers being the most common ones. Before this change the script would error on such emails or sometimes replace the unicode characters with questionmarks "?".
- Function takes argument as an input and then encodes it in ascii while ignoring any malformed data. It then returns an ASCII string without the unicode characters.
- Currently implemented for "from" and "subject" handling.
- Update README.md. [Raphaël Vinot]
Not using travis anymore.
v2.4.148 (2021-08-05)
---------------------
New
~~~
- Method `sharing_group_exists` [Jakub Onderka]
- Method `update_sharing_group` [Jakub Onderka]
- Save one REST call when initialize PyMISP class. [Jakub Onderka]
- Method `organisation_exists` [Jakub Onderka]
- Method `sharing_group_exists` [Jakub Onderka]
- Method `update_sharing_group` [Jakub Onderka]
- `to_dict` method supports `json_format` parameter. [Jakub Onderka]
- Method `organisation_exists` [Jakub Onderka]
- Method `sharing_group_exists` [Jakub Onderka]
- Method `update_sharing_group` [Jakub Onderka]
- Save one REST call when initialize PyMISP class. [Jakub Onderka]
- Method `organisation_exists` [Jakub Onderka]
- Method `sharing_group_exists` [Jakub Onderka]
- Method `update_sharing_group` [Jakub Onderka]
- Exclude decayed attributes in search. [Raphaël Vinot]
Fix #753
Changes
~~~~~~~
- Bump objects template. [Raphaël Vinot]
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Remove duplicates tests. [Raphaël Vinot]
- [testlive_comprehensive] correct path to access sharing group
releasability after edit. [iglocska]
- Properly validate update_sharing_group without pythonify. [Raphaël
Vinot]
- Bump missing dep. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- [testlive_comprehensive] correct path to access sharing group
releasability after edit. [iglocska]
- [authkey test] removed from testlive_comprehensive. [iglocska]
- the default now enables advanced authkeys making the retriaval of keys impossible after the user creation
- Do not load schema for event when not necessary. [Jakub Onderka]
- Bump deps. [Raphaël Vinot]
- `get_taxonomy` supports namespace. [Jakub Onderka]
- Properly validate update_sharing_group without pythonify. [Raphaël
Vinot]
- Bump missing dep. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- [testlive_comprehensive] correct path to access sharing group
releasability after edit. [iglocska]
- [authkey test] removed from testlive_comprehensive. [iglocska]
- the default now enables advanced authkeys making the retriaval of keys impossible after the user creation
- Do not load schema for event when not necessary. [Jakub Onderka]
- Bump deps. [Raphaël Vinot]
- `get_taxonomy` supports namespace. [Jakub Onderka]
- Properly validate update_sharing_group without pythonify. [Raphaël
Vinot]
- Bump missing dep. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- [testlive_comprehensive] correct path to access sharing group
releasability after edit. [iglocska]
- [authkey test] removed from testlive_comprehensive. [iglocska]
- the default now enables advanced authkeys making the retriaval of keys impossible after the user creation
- Do not load schema for event when not necessary. [Jakub Onderka]
- Bump deps. [Raphaël Vinot]
- `get_taxonomy` supports namespace. [Jakub Onderka]
- Update mypy, change accordingly. [Raphaël Vinot]
Fix
~~~
- Typo in key name. [Raphaël Vinot]
- [test] test_sharing_groups. [Jakub Onderka]
- [test] test_sharing_groups again. [Jakub Onderka]
- [test] test_sharing_groups. [Jakub Onderka]
- Typo in key name. [Raphaël Vinot]
- [test] test_sharing_groups again. [Jakub Onderka]
- [test] test_sharing_groups. [Jakub Onderka]
- [test] test_sharing_groups again. [Jakub Onderka]
- [test] test_sharing_groups. [Jakub Onderka]
- Flake8 stuff. [Raphaël Vinot]
- Revert rename, fix mypy. [Raphaël Vinot]
- Properly handle the case MISP is in a sub redirect. [Raphaël Vinot]
Fix #757
Other
~~~~~
- Revert "chg: Remove legacy stix converter." [iglocska]
This reverts commit 94ce4a367bbde9284a6f29e6e6152c91de386879.
- breaks misp-stix converter, reverting it for now, let's find a way to deprecate this without outright removing it
- Revert "chg: Remove legacy stix converter." [iglocska]
This reverts commit 94ce4a367bbde9284a6f29e6e6152c91de386879.
- breaks misp-stix converter, reverting it for now, let's find a way to deprecate this without outright removing it
- Revert "chg: Remove legacy stix converter." [iglocska]
This reverts commit 94ce4a367bbde9284a6f29e6e6152c91de386879.
- breaks misp-stix converter, reverting it for now, let's find a way to deprecate this without outright removing it
v2.4.144 (2021-06-07)
---------------------
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump object templates. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
Other
~~~~~
- Fix misp API response content parsing. [Silvian I]
v2.4.143 (2021-05-14)
---------------------
New
~~~
- Method to get the raw object template. [Raphaël Vinot]
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version, deps. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump objects templates. [Raphaël Vinot]
Fix
~~~
- First-seen and last-seen on attributes and objects were not checked
for sanity. [Raphaël Vinot]
- Remove search_all example, use search instead. [Raphaël Vinot]
v2.4.142 (2021-04-26)
---------------------
New
~~~
- Support for correlation exclusion list. [Raphaël Vinot]
Fix #732
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Fix test suite. [Raphaël Vinot]
- Bump objects templates. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Add comment for controller attribute in search. [Raphaël Vinot]
Fix
~~~
- Enable/disable feeds. [Raphaël Vinot]
- Mistake in mypy config. [Raphaël Vinot]
- Exclude data from mypy. [Raphaël Vinot]
v2.4.141.1 (2021-04-02)
-----------------------
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Re-bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
Other
~~~~~
- Fix bump version, deps, templates. [Raphaël Vinot]
- Update README.md. [Raphaël Vinot]
v2.4.141 (2021-04-01)
---------------------
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Get_uuid_or_id_from_abstract_misp accepts dict. [Raphaël Vinot]
- Remove references to ExpandedPyMISP. [Raphaël Vinot]
Fix #721
- Follow best practices and remove the logging handler. [Raphaël Vinot]
- Strip NULL string from value. [Raphaël Vinot]
https://github.com/MISP/PyMISP/issues/678
- Bump deps. [Raphaël Vinot]
- Raise exception on missing template in CSVLoader. [Raphaël Vinot]
- Bump templates. [Raphaël Vinot]
- Re-bump objects. [Raphaël Vinot]
- Bump object templates. [Raphaël Vinot]
- Add test case, fix mypy. [Raphaël Vinot]
- Take simple_value as value in MISPObject.add_attribute. [Raphaël
Vinot]
Fix
~~~
- Use get_uuid_or_id_from_abstract_misp in tag methods. [Raphaël Vinot]
Fix #725
- Skip nameless sections in ELF. [Raphaël Vinot]
- Make reportlab tests optional if missing dep. [Raphaël Vinot]
- Enable taxonomy failed if global pythonify is on. [Raphaël Vinot]
- Properly pass content-type. [Raphaël Vinot]
- Re-enable support for uploading STIX 1 documents. [Raphaël Vinot]
Fix #711
v2.4.140 (2021-03-03)
---------------------
New
~~~
- Soft delete object in MISPEvent. [Raphaël Vinot]
Fix #706
- Add in ability to add a new cluster relation. [Tom King]
- MISP Galaxy 2.0 capability. [Tom King]
- Soft delete object in MISPEvent. [Raphaël Vinot]
Fix #706
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump object templates. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- [describetypes] updated. [Alexandre Dulaunoy]
- Bump objects templates. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump tests for galaxy cluster. [Raphaël Vinot]
- Improve Pydoc on search method's timestamp parameter. [Raphaël Vinot]
Fix #708
- Bump poetry file. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- [data] describeTypes updated. [Alexandre Dulaunoy]
- Add deprecation warning for Python < 3.8. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Don't parse the meta key into cluster elements on a MISPEvent, but
allow users to manually perform this action. [Tom King]
- Add in nosetests for MISP Galaxy functions, check default key as a
dict attribute not MISPAbstract attribute. [Tom King]
- Add in more Galaxy 2.0 functions and code cleanup. [Tom King]
- Add in add_cluster function and ability to search clusters within a
galaxy. [Tom King]
- Remove legacy stix converter. [Raphaël Vinot]
- Improve Pydoc on search method's timestamp parameter. [Raphaël Vinot]
Fix #708
- Bump poetry file. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- [data] describeTypes updated. [Alexandre Dulaunoy]
- Add deprecation warning for Python < 3.8. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
Fix
~~~
- Typo in tests. [Raphaël Vinot]
- Make mypy happy in python 3.6 and 3.7. [Raphaël Vinot]
- Cosmetic changes, fix mypy. [Raphaël Vinot]
- Support text search again. [Raphaël Vinot]
Fix #705
- Do not add the serial-number twice. [Raphaël Vinot]
- Skip PE section if name is none AND size is 0. [Raphaël Vinot]
- Urllib3.__version__ may not have a patch number. [Raphaël Vinot]
fix https://github.com/MISP/PyMISP/issues/698
- Fix mispevent edit test by including default and distribution keys on
a GalaxyCluster. [Tom King]
- Support text search again. [Raphaël Vinot]
Fix #705
- Do not add the serial-number twice. [Raphaël Vinot]
- Skip PE section if name is none AND size is 0. [Raphaël Vinot]
- Urllib3.__version__ may not have a patch number. [Raphaël Vinot]
fix https://github.com/MISP/PyMISP/issues/698
Other
~~~~~
- Removed unused import. [Nick]
- Supress ssl warnings. [Nick]
- Re-added error checking for defaults. [Nick]
- Deleted all references to org as it's unneeded. [Nick]
- Re-added brackets. [Nick]
- Multiple updates to proofpoint example. [Nick]
- Added additionally necessary keys to keys.py.example
- Added error check for unset keys
- Used built-in HTTP Basic Auth for requests instead of manually-created header
- Removed setting of orgc as that's pulled from the MISP key being used
-
- Removed cast of str to str. [Nick]
- Added check for invalid creds. [Nick]
Without the added check, the script will error out on line 29 since the key doesn't exist in the dict. This at least gives a reason.
- Removed unused import. [Nick]
- Supress ssl warnings. [Nick]
- Re-added error checking for defaults. [Nick]
- Deleted all references to org as it's unneeded. [Nick]
- Re-added brackets. [Nick]
- Multiple updates to proofpoint example. [Nick]
- Added additionally necessary keys to keys.py.example
- Added error check for unset keys
- Used built-in HTTP Basic Auth for requests instead of manually-created header
- Removed setting of orgc as that's pulled from the MISP key being used
-
- Removed cast of str to str. [Nick]
- Added check for invalid creds. [Nick]
Without the added check, the script will error out on line 29 since the key doesn't exist in the dict. This at least gives a reason.
v2.4.138 (2021-02-08)
---------------------
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
v2.4.137.4 (2021-02-04)
-----------------------
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump objects. [Raphaël Vinot]
- Add kw_params to tags. [Raphaël Vinot]
- Bump objects. [Raphaël Vinot]
- Bump template ID in test case. [Raphaël Vinot]
v2.4.137.3 (2021-02-02)
-----------------------
Changes
~~~~~~~
- Bump version. [Raphaël Vinot]
- Bump changelog. [Raphaël Vinot]
- Bump objects. [Raphaël Vinot]
- Fix and improve optional dependencies. [Raphaël Vinot]
- Make brotli optional. [Raphaël Vinot]
v2.4.137.2 (2021-02-01)
-----------------------
New
~~~
- Add in ability to create/update/delete MISP Event Reports. [Tom King]
- Hard delete flag for objects. [Raphaël Vinot]
- Fail if a duplicate object is added to an event. [Raphaël Vinot]
- Support brotli compression. [Jakub Onderka]
- Hard delete flag for objects. [Raphaël Vinot]
- Fail if a duplicate object is added to an event. [Raphaël Vinot]
- Add in ability to create/update/delete MISP Event Reports. [Tom King]
- Add in ability to create/update/delete MISP Event Reports. [Tom King]
- Hard delete flag for objects. [Raphaël Vinot]
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Add brotli support in the dependencies. [Raphaël Vinot]
- Make mypy happy. [Raphaël Vinot]
- Make clear that to_json returns str. [Raphaël Vinot]
- Disable correlation on malware-sample for FileObject. [Raphaël Vinot]
- Bump objects templates. [Raphaël Vinot]
- Add missing autodoc. [Raphaël Vinot]
fix #693
- Add in delete function for a MISP Object. [Tom King]
- Fix return of delete_event_report. [Raphaël Vinot]
- Remove critical warning if lief is not installed. [Raphaël Vinot]
Fix https://github.com/MISP/MISP/issues/6908
- Bump deps. [Raphaël Vinot]
- Allow response of delete to be pythonify, add in nosetest. [Tom King]
- Add ability to get event reports from the Event ID. [Tom King]
- Remove travis file, GH Actions is better. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Remove critical warning if lief is not installed. [Raphaël Vinot]
Fix https://github.com/MISP/MISP/issues/6908
- Add test case fir add_attribute and enforceWarninglist=True. [Raphaël
Vinot]
- Add testcase with breakOnDuplicate in a MISPObject. [Raphaël Vinot]
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Add test case for page/limit in logs search. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Improve docstring for get_event. [Raphaël Vinot]
fix #686
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Show size when the json is not loadable. [Raphaël Vinot]
- Add authenticode support in generate_file_objects. [Raphaël Vinot]
- Use lief 0.11.0, generate authenticode entries. [Raphaël Vinot]
- Bump objects. [Raphaël Vinot]
- Bump deps, add 3.9 in GH. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump deps, objects templates. [Raphaël Vinot]
- Make clear that to_json returns str. [Raphaël Vinot]
- Disable correlation on malware-sample for FileObject. [Raphaël Vinot]
- Bump objects templates. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Add missing autodoc. [Raphaël Vinot]
fix #693
- Add in delete function for a MISP Object. [Tom King]
- Bump deps. [Raphaël Vinot]
- Fix return of delete_event_report. [Raphaël Vinot]
- Remove travis file, GH Actions is better. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Remove critical warning if lief is not installed. [Raphaël Vinot]
Fix https://github.com/MISP/MISP/issues/6908
- Add test case fir add_attribute and enforceWarninglist=True. [Raphaël
Vinot]
- Add testcase with breakOnDuplicate in a MISPObject. [Raphaël Vinot]
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Add test case for page/limit in logs search. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Improve docstring for get_event. [Raphaël Vinot]
fix #686
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Show size when the json is not loadable. [Raphaël Vinot]
- Add authenticode support in generate_file_objects. [Raphaël Vinot]
- Use lief 0.11.0, generate authenticode entries. [Raphaël Vinot]
- Bump objects. [Raphaël Vinot]
- Bump deps, add 3.9 in GH. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump deps, objects templates. [Raphaël Vinot]
- Allow response of delete to be pythonify, add in nosetest. [Tom King]
- Add ability to get event reports from the Event ID. [Tom King]
- Remove travis file, GH Actions is better. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Remove critical warning if lief is not installed. [Raphaël Vinot]
Fix https://github.com/MISP/MISP/issues/6908
- Add test case fir add_attribute and enforceWarninglist=True. [Raphaël
Vinot]
- Add testcase with breakOnDuplicate in a MISPObject. [Raphaël Vinot]
Fix
~~~
- Flake error. [Raphaël Vinot]
- Update testlive accordingly. [Raphaël Vinot]
- Better warning if lief is outdated. [Raphaël Vinot]
- Call the AbstractMISP.from_dict at the end of the function to ensure
the edited flag remains false. [Tom King]
- Better warning if lief is outdated. [Raphaël Vinot]
- Update minimal dependency for lief in setup.py. [Raphaël Vinot]
- [dev mode only] force older jedi to avoid ipython exception. [Raphaël
Vinot]
- Add python 3.9 in GH Actions. [Raphaël Vinot]
- Update testlive accordingly. [Raphaël Vinot]
- Better warning if lief is outdated. [Raphaël Vinot]
- Update minimal dependency for lief in setup.py. [Raphaël Vinot]
- [dev mode only] force older jedi to avoid ipython exception. [Raphaël
Vinot]
- Add python 3.9 in GH Actions. [Raphaël Vinot]
- Call the AbstractMISP.from_dict at the end of the function to ensure
the edited flag remains false. [Tom King]
v2.4.137.1 (2021-01-21)
-----------------------
New
~~~
- Fail if a duplicate object is added to an event. [Raphaël Vinot]
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Add test case for page/limit in logs search. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Improve docstring for get_event. [Raphaël Vinot]
fix #686
- Bump changelog. [Raphaël Vinot]
Fix
~~~
- Better warning if lief is outdated. [Raphaël Vinot]
- Update minimal dependency for lief in setup.py. [Raphaël Vinot]
v2.4.137 (2021-01-20)
---------------------
New
~~~
- Allow to pass an object template to MISPObject.__init__ [Raphaël
Vinot]
MISPObject part of #6670
Changes
~~~~~~~
- Bump version. [Raphaël Vinot]
- Show size when the json is not loadable. [Raphaël Vinot]
- Add authenticode support in generate_file_objects. [Raphaël Vinot]
- Use lief 0.11.0, generate authenticode entries. [Raphaël Vinot]
- Bump objects. [Raphaël Vinot]
- Bump deps, add 3.9 in GH. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump deps, objects templates. [Raphaël Vinot]
- Add controller argument to get_csv script. [Raphaël Vinot]
- [test] file object template are now 24. [Alexandre Dulaunoy]
- [test] file object template is now at version 24. [Alexandre Dulaunoy]
- [misp-objects] updated. [Alexandre Dulaunoy]
- [type] favicon-mmh3 is the murmur3 hash of a favicon as used in
Shodan. [Alexandre Dulaunoy]
- [misp-objects] updated to the latest version. [Alexandre Dulaunoy]
- Clarify misp_objects_template_custom. [Raphaël Vinot]
- Add docstring for misp_objects_template_custom. [Raphaël Vinot]
- Trigger GH actions on PR. [Raphaël Vinot]
- Improve documentation of MISPAttribute.malware_binary. [Raphaël Vinot]
- Remove trailing space. [Raphaël Vinot]
- On-demand decryption of malware-binary, speeds up pythonify. [Raphaël
Vinot]
- Force a few packages versions. [Raphaël Vinot]
Fix
~~~
- [dev mode only] force older jedi to avoid ipython exception. [Raphaël
Vinot]
- Add python 3.9 in GH Actions. [Raphaël Vinot]
- Do not fail if extract_msg is missing. [Raphaël Vinot]
- Properly decode the body depending on the encoding of the email.
[Raphaël Vinot]
Fix #671
- Properly match IO in load event. [Raphaël Vinot]
- Typing on recent mypy. [Raphaël Vinot]
- Typing edge case. [Raphaël Vinot]
- Add attribute dict as proposal. [Raphaël Vinot]
Other
~~~~~
- Noticed that test data mail_5.msg was malformatted. Replaced with
working test msg. [seamus tuohy]
- Updated emailobject. [seamus tuohy]
Email object no longer requires extra php libraries for install.
Tests have been expanded to improve coverage.
RTF encapsulated HTML and Plain Text will now be de-encapsulated.
The raw MSG binary will now be included in the extracted email object.
- Adding check if "from" is in the "received" header row. [nighttardis]
- Update `vmray_automation` to stay compatible with the changes made to
`vmray_import` MISP modules. [Jens Thom]
- Update mispevent.py. [Raphaël Vinot]
v2.4.135.3 (2020-11-24)
-----------------------
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Improve typing. [Raphaël Vinot]
- Improve add_attribute with a list. [Raphaël Vinot]
Fix
~~~
- Do not fail on PyMISP import when mail-parser is not present. [Raphaël
Vinot]
v2.4.135.2 (2020-11-24)
-----------------------
New
~~~
- Add Github workflow. [Raphaël Vinot]
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Improve error message if a type in missing. [Raphaël Vinot]
- [type] process-state added. [Alexandre Dulaunoy]
- Bump misp-objects. [Raphaël Vinot]
- [misp-objects] updated. [Alexandre Dulaunoy]
- Add path to CSV sample files. [Raphaël Vinot]
- [types] jarm-fingerprint added. [Alexandre Dulaunoy]
Fix
~~~
- Remove python 3.9 from action (lief not supported yet) [Raphaël Vinot]
- Initialize submodules in gh action. [Raphaël Vinot]
- Make mail-parser really optional. [Raphaël Vinot]
v2.4.135.1 (2020-11-24)
-----------------------
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version, travis install. [Raphaël Vinot]
- Make mail-parser an optional dependency. [Raphaël Vinot]
v2.4.135 (2020-11-23)
---------------------
New
~~~
- Test parsing just email header. [Jakub Onderka]
- Test parsing outlook message format. [Jakub Onderka]
- Add tests for EmailObject. [Jakub Onderka]
- Refactored emailobject generator. [Jakub Onderka]
- Export display name from email. [Jakub Onderka]
- Parse date from email. [Jakub Onderka]
- Method to check attribute and object existence. [Jakub Onderka]
- Allow to get just event metadata after add_event and edit_event.
[Jakub Onderka]
- Method to check event existence. [Jakub Onderka]
- Add method to search for tags. [Raphaël Vinot]
fix #648
Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Add search info field with "\" [Raphaël Vinot]
- Improve documentation of search_index. [Raphaël Vinot]
- Improve error handling for Outlook emails. [Raphaël Vinot]
- Bump object templates. [Raphaël Vinot]
- Bump dependencies. [Raphaël Vinot]
- Update gitignore. [Raphaël Vinot]
fix #613
- Do not split a string into a list in complex query builder. [Raphaël
Vinot]
fix #597
- Force enable debug in test, test update tags. [Raphaël Vinot]
- Use REST search for the tags. [Raphaël Vinot]
Related to comments on a1326f2cf2bcfd6e285188e0661b12076fe92747
- Add typing meta. [Raphaël Vinot]
Fix
~~~
- [emailobject] Correctly parse multiple addresses. [Jakub Onderka]
- Test suite for exists calls. [Raphaël Vinot]
- Path for event creating and editing. [Jakub Onderka]
- Object_uuid could be None. [Raphaël Vinot]
Fix #640
- Last_seen has to be after first_seen, and it should habe been failing
before. [Raphaël Vinot]
- Missing f-string marker. [Raphaël Vinot]
- Fix: Docstring improvment based on @chrisinmtown's feedback. [Raphaël
Vinot]
Other
~~~~~
- We can now upload stix object directly. File is not necessary. [Remy
Dewailly]
- We can now upload stix object directly. File is not necessary. [Remy
Dewailly]
v2.4.134 (2020-11-02)
---------------------
Changes
~~~~~~~
- Bump Changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump misp-objects. [Raphaël Vinot]
- Keep connection alive between requests. [Jakub Onderka]
- Bump deps. [Raphaël Vinot]
- Format docstrings in mispevent.py. [Lott, Christopher (cl778h)]
Add ":param " prefix to parameters to improve ReadTheDocs output.
Fix some minor typos in docstrings.
- Bump deps. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump changelog. [Raphaël Vinot]
Fix
~~~
- Remove duplicate check if debug logging is enabled. [Jakub Onderka]
- Do now fail on requests returning plain text. [Raphaël Vinot]
Fix #639
Other
~~~~~
- Revert "Update .travis.yml" [Raphaël Vinot]
lief isn't compatible with python 3.9
This reverts commit e10843fa33c9a08b7da4ef24cbce457be53a7459.
- Update .travis.yml. [Raphaël Vinot]
Add python 3.9
- Drop `encoding=` in Python 3.9. [Friedrich Lindenberg]
v2.4.133 (2020-10-16)
---------------------
New
~~~
- [attribute type] telfhash added. [Alexandre Dulaunoy]
- [add_gitlab_user] new gitlab user fetch script to MISP object.
[Alexandre Dulaunoy]
usage: add_gitlab_user.py [-h] -e EVENT [-f] -u USERNAME [-l LINK]
Fetch GitLab user details and add it in object in MISP
optional arguments:
-h, --help show this help message and exit
-e EVENT, --event EVENT
Event ID to update
-f, --force-template-update
-u USERNAME, --username USERNAME
GitLab username to add
-l LINK, --link LINK Url to access the GitLab instance, Default is
www.gitlab.com.
- [example] add_github_user example - WiP. [Alexandre Dulaunoy]
usage: add_github_user.py [-h] -e EVENT [-f] -u USERNAME
Fetch GitHub user details and add it in object in MISP
optional arguments:
-h, --help show this help message and exit
-e EVENT, --event EVENT
Event ID to update
-f, --force-template-update
-u USERNAME, --username USERNAME
GitHub username to add
- Method to get the new version of the templates. [Raphaël Vinot]
- Delete tags via update_attribute, search by sharing group. [Tom King]
Changes
~~~~~~~
- Bump object templates. [Raphaël Vinot]
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump test cases. [Raphaël Vinot]
- [type] updated. [Alexandre Dulaunoy]
- Bump file obj version in tests. [Raphaël Vinot]
- [data] misp-objects updated. [Alexandre Dulaunoy]
- Bump build system to poetry 1.1. [Raphaël Vinot]
- [type] new type added. [Alexandre Dulaunoy]
- [add_github_user] add ssh keys of the user in the MISP object.
[Alexandre Dulaunoy]
- [add_github_user] more fields added from the GitHub API. [Alexandre
Dulaunoy]
- Bump deps, objects. [Raphaël Vinot]
- Add test for delete=True in get_event. [Raphaël Vinot]
- [add_github_user] add following to the MISP object. [Alexandre
Dulaunoy]
- Bump dependencies. [Raphaël Vinot]
- Pass a list to add_attributes. [Raphaël Vinot]
- Use MISPObject instead of GenericObjectGenerator. [Raphaël Vinot]
- [doc] add a reference to the license. [Alexandre Dulaunoy]
- Add docstrings and extend conf.py for RTD. [Lott, Christopher
(cl778h)]
Add minimal docstrings to public methods so ReadTheDocs will display them.
Add autodoc mock import for lief so RTD can generate HTML for tools.
This fixes issue #626
- Remove PyMISPExpanded from the docs. [Raphaël Vinot]
- Add comments to ELF, PE, and MachO object generators. [Raphaël Vinot]
- Improve error message, add comments, rename whitelist->allowedlist.
[Raphaël Vinot]
- Remove SG search for search() func as this doesn't support SG
searching, but the index does. [Tom King]
Fix
~~~
- Test on macosx. [Raphaël Vinot]
Fix #630
- Do not modify default_attributes_parameters in MISPObject. [Raphaël
Vinot]
- Wrong call to pymisp.search_index. [Raphaël Vinot]
- Few outdated calls in the tutorial. [Raphaël Vinot]
- Make flake8 happy. [Raphaël Vinot]
- Merge SG params to allow search. [Tom King]
Other
~~~~~
- Fix PyMISP repo URL. [garanews]
MISP/PyMISP vs CIRCL/PyMISP
- Fix typo. [garanews]
fix typo
- Attempt to decode utf-8-sig encoded emails. [seamus tuohy]
eml files downloaded from Windows Online security on some Windows 11
systems are automatically encoded in UTF with a byte order mark (BOM)
at the front of the file. This will cause the email parser to fail.
This is a somewhat isolated problem. It only will affects a small
subset of Windows users who download and re-upload eml files. But,
this small subset of users is the target user-base for the MISP
email module: low expertiese users who wish to quickly share
high-value indicators on an ad-hoc basis.
While this fix could be tacked onto the MISP email module instead of
here, I beleive that this fix is more appropriate in the PyMISP object
code. As the "email" object parser this object should be built to
parse all manner of emails that it may encounter. This includes common
malformations such as this one and, even horrors such as, the .msg
format. This commit adds a generically named "attempt_decoding"
function which can be expanded to address all manner of sins that
are encountered in the future.
v2.4.131 (2020-09-08)
---------------------
New
~~~
- [test] Validate tag removal. [Raphaël Vinot]