GMAD: Graph-based Malware Activity Detection by DNS traffic analysis

• Published in: Computer communications Vol. 49; pp. 33 - 47
• Main Authors: Lee, Jehyun, Lee, Heejo
• Format: Journal Article
• Language: English
• Published: Kidlington Elsevier B.V 01-08-2014; Elsevier
• Subjects: Applied sciences; Botnet; Client server systems; Computer science; control theory; systems; Computer systems and distributed systems. User interface; DNS; Domain names; Exact sciences and technology; Graph clustering; Graphs; Information retrieval. Graph; Internet; Malware; Malware domain name; Memory and file management (including protection and security); Memory organisation. Data processing; Queries; Sequential correlation; Software; Theoretical computing; Traffic engineering; Traffic flow; Asia; Korea; Graph clustering; DNS; Sequential correlation; Malware domain name; Botnet; Network structure; Database query; Delinquency; Addressing; Graph connectivity; Robustness; Forgery; Malware; Computer security; Computer attack; Domain name; Countermeasurement; Blocking; Cluster; Grouping; Graph theory; Failure rate; Intelligent agent; Traffic management; Internet; Domain decomposition; Monitoring control system; Intrusion detection systems
• ISSN: 0140-3664; 1873-703X
• DOI: 10.1016/j.comcom.2014.04.013

Malicious activities on the Internet are one of the most dangerous threats to Internet users and organizations. Malicious software controlled remotely is addressed as one of the most critical methods for executing the malicious activities. Since blocking domain names for command and control (C&C) of the malwares by analyzing their Domain Name System (DNS) activities has been the most effective and practical countermeasure, attackers attempt to hide their malwares by adopting several evasion techniques, such as client sub-grouping and domain flux on DNS activities. A common feature of the recently developed evasion techniques is the utilization of multiple domain names for render malware DNS activities temporally and spatially more complex. In contrast to analyzing the DNS activities for a single domain name, detecting the malicious DNS activities for multiple domain names is not a simple task. The DNS activities of malware that uses multiple domain names, termed multi-domain malware, are sparser and less synchronized with respect to space and time.
In this paper, we introduce a malware activity detection mechanism, GMAD: Graph-based Malware Activity Detection that utilizes a sequence of DNS queries in order to achieve robustness against evasion techniques. GMAD uses a graph termed Domain Name Travel Graph which expresses DNS query sequences to detect infected clients and malicious domain names. In addition to detecting malware C&C domain names, GMAD detects malicious DNS activities such as blacklist checking and fake DNS querying. To detect malicious domain names utilized to malware activities, GMAD applies domain name clustering using the graph structure and determines malicious clusters by referring to public blacklists. Through experiments with four sets of DNS traffic captured in two ISP networks in the U.S. and South Korea, we show that GMAD detected thousands of malicious domain names that had neither been blacklisted nor detected through group activity of DNS clients. In a detection accuracy evaluation, GMAD showed an accuracy rate higher than 99% on average, with a higher than 90% precision and lower than 0.5% false positive rate. It is shown that the proposed method is effective for detecting multi-domain malware activities irrespective of evasion techniques.