<HTML><HEAD></HEAD>
<BODY dir=ltr>
<DIV dir=ltr>
<DIV style="FONT-FAMILY: 'Calibri'; COLOR: #000000; FONT-SIZE: 12pt">
<DIV>Hi Kevin,</DIV>
<DIV> </DIV>
<DIV>I know of Ruminate IDS project that just does what you want to do. it’s
website is <A title=http://ruminate-ids.org/
href="http://ruminate-ids.org/">http://ruminate-ids.org/</A> . I
think file carving has a lot of challenges specially if you want it to scale
properly.</DIV>
<DIV
style="FONT-STYLE: normal; DISPLAY: inline; FONT-FAMILY: 'Calibri'; COLOR: #000000; FONT-SIZE: small; FONT-WEIGHT: normal; TEXT-DECORATION: none">
<DIV style="FONT: 10pt tahoma">
<DIV><FONT size=3 face=Calibri></FONT> </DIV>
<DIV><FONT size=3 face=Calibri>I hope this helps.</FONT></DIV>
<DIV><FONT size=3 face=Calibri></FONT> </DIV>
<DIV><FONT size=3 face=Calibri>best,</FONT></DIV>
<DIV><FONT size=3 face=Calibri></FONT> </DIV>
<DIV><FONT size=3 face=Calibri>Javier</FONT></DIV>
<DIV> </DIV>
<DIV><FONT size=3 face=Calibri></FONT> </DIV>
<DIV style="BACKGROUND: #f5f5f5">
<DIV style="font-color: black"><B>From:</B> <A title=kevross33@googlemail.com
href="mailto:kevross33@googlemail.com">Kevin Ross</A> </DIV>
<DIV><B>Sent:</B> Monday, April 11, 2011 7:15 AM</DIV>
<DIV><B>To:</B> <A title=victor@inliniac.net
href="mailto:victor@inliniac.net">Victor Julien</A> ; <A
title=oisf-users@openinfosecfoundation.org
href="mailto:oisf-users@openinfosecfoundation.org">oisf-users@openinfosecfoundation.org</A>
</DIV>
<DIV><B>Subject:</B> Re: [Oisf-users] Suricata File Carving - Malware
Detection</DIV></DIV></DIV>
<DIV> </DIV></DIV>
<DIV
style="FONT-STYLE: normal; DISPLAY: inline; FONT-FAMILY: 'Calibri'; COLOR: #000000; FONT-SIZE: small; FONT-WEIGHT: normal; TEXT-DECORATION: none">I
am definitely not suggesting this should be done on the wire or by the main
Suricata processes. What I mean once suricata drops it to disk maybe it could
have a process to analyse and feed the alerts back into suricata to have it
output an alert in unified2. Sure once suricata has file_extract options
creating your own script to run things on the file is easy but suricata could do
it straight out (or at least have it pass off). This way those users who are not
sure of the actual benefits or how to analyse files on disk to detect malware
and stuff don't have to think about it. Examples of what could be done:<BR><BR>-
Scan file with clamav<BR>- Check for suspicious IATs such as ones checking for
debuggers or other stuff and the ability to possible threshold against a score.
That way suricata rather then generate an alert for every executable, suspicious
executables can be alerted on only (which with the right tuning could even help
zero in on unknown malware samples). <BR>- Alerting on file type mismatches i.e
server claims to send an image and yet suricata is carving out an exe from the
stream or carving flash out of an excel file like the recent vulnerability (I
guess this one could possibly be handed by suricata itself if a user wanted such
alerts).<BR><BR>My point is while making up your own scripts to do stuff (run
clamav, jsunpack etc on files) it is nice to have it handle it by default (if
you wanted it) and means more users who are learning or unsure how to take
advantage of file carving or why you would want to could benefit from it.
<BR><BR>Kev<BR><BR><BR>
<DIV class=gmail_quote>On 11 April 2011 10:13, Victor Julien <SPAN
dir=ltr><<A href="mailto:victor@inliniac.net"
target=_blank>victor@inliniac.net</A>></SPAN> wrote:<BR>
<BLOCKQUOTE
style="BORDER-LEFT: #ccc 1px solid; MARGIN: 0px 0px 0px 0.8ex; PADDING-LEFT: 1ex"
class=gmail_quote>
<DIV>On 04/09/2011 02:51 AM, Kevin Ross wrote:<BR>> Stick with me with
this. This is pescanner from the malware cookbook. I have<BR>> modified it
slightly to have more IAT alerts after reading this<BR>> <A
href="http://www.sans.org/reading_room/whitepapers/malicious/rss/_33649"
target=_blank>http://www.sans.org/reading_room/whitepapers/malicious/rss/_33649</A>
as it has<BR>> a big list of IATs at the end and their malware uses so I
added them in (in<BR>> this case I would say all those IATs look bad in
combination). This was Zeus<BR>> with the file carved out a pcap on <A
href="http://openpacket.org" target=_blank>openpacket.org</A>. You can see
the<BR>> virtustotal report for the MD5 when I searched for it here<BR>>
<A
href="http://www.virustotal.com/file-scan/report.html?id=2f59173cf3842b3a72ac04404ab045c339cbc6f021f24b977a27441ea881e95b-1295056538"
target=_blank>http://www.virustotal.com/file-scan/report.html?id=2f59173cf3842b3a72ac04404ab045c339cbc6f021f24b977a27441ea881e95b-1295056538</A><BR>><BR>>
Now what I was thinking is if they file_extract options were put into<BR>>
suricata as was mentioned after the last meeting would it be hard to
have<BR>> suricata or another tool check IATs, entropy, clamav scan
possibly or<BR>> checking the MD5 against virustotal, shadowserver etc to
determine if is is<BR>> possibly malicious? Even the IATs for their
possible usage and risk and then<BR>> a threshold to then determine if the
file is likely bad. If the file was<BR>> possible bad then a preprocessor
style alert could be generated by suricata<BR>> with the relevant
information about the file and the possibly malicious file<BR>> could be
moved to a malicious folder or something to be stored while if the<BR>>
user wants executables or other files that are not detected as anything
or<BR>> suspicious could be deleted meaning you have a folder of likely
samples for<BR>> stuff entering your network. What do people
think?<BR><BR></DIV>This analysis (mostly) requires the full file, right? In
that case I<BR>think it makes more sense for Suricata to drop the file to disk
and let<BR>a separate process do post
inspection.<BR><BR>Cheers,<BR>Victor<BR><BR><BR>--<BR>---------------------------------------------<BR>Victor
Julien<BR><A href="http://www.inliniac.net/"
target=_blank>http://www.inliniac.net/</A><BR>PGP: <A
href="http://www.inliniac.net/victorjulien.asc"
target=_blank>http://www.inliniac.net/victorjulien.asc</A><BR>---------------------------------------------<BR><BR>_______________________________________________<BR>Oisf-users
mailing list<BR><A href="mailto:Oisf-users@openinfosecfoundation.org"
target=_blank>Oisf-users@openinfosecfoundation.org</A><BR><A
href="http://lists.openinfosecfoundation.org/mailman/listinfo/oisf-users"
target=_blank>http://lists.openinfosecfoundation.org/mailman/listinfo/oisf-users</A><BR></BLOCKQUOTE></DIV><BR>
<P>
<HR>
_______________________________________________<BR>Oisf-users mailing
list<BR>Oisf-users@openinfosecfoundation.org<BR>http://lists.openinfosecfoundation.org/mailman/listinfo/oisf-users<BR></DIV></DIV></DIV></BODY></HTML>