Detection of application layer DDoS attacks using big data technologies

Abstract

In today’s age, where data is of prime importance and rate at which data generated and sources of data generation is quite huge. The attacks on the data have increased manifold due to which its security is of prime importance. The traditional defense mechanisms are proving to be inadequate. In this paper, a new method to analyses network logs using R and Big data technologies is introduced. The approach detects fraudulent ip address in the network logs based on a set of conditions using pig scripting language. The results of using this method to detect the attack on the dataset is also presented.

Subject Classification:

• 08A70

Keywords:

• Big Data
• Distributed Denial of Service
• DoS
• DDoS
• Application layer Attacks
• Network Layer Attacks
• Apache Pig
• Sampling theory
• Admissibility