From: Adriana Draghici Date: Thu, 11 Feb 2010 12:42:55 +0000 (+0200) Subject: report - new diagrams, parser 30% completed X-Git-Tag: getopt_long~170 X-Git-Url: http://p2p-next.cs.pub.ro/gitweb/?a=commitdiff_plain;h=d404a269bf47020498d494479bbee45a9c6278b1;p=cs-p2p-next.git report - new diagrams, parser 30% completed --- diff --git a/report/img/Logarch_part1.png b/report/img/Logarch_part1.png new file mode 100644 index 0000000..073c1ad Binary files /dev/null and b/report/img/Logarch_part1.png differ diff --git a/report/img/Logarch_part2.png b/report/img/Logarch_part2.png new file mode 100644 index 0000000..5464dcc Binary files /dev/null and b/report/img/Logarch_part2.png differ diff --git a/report/logarch.tex b/report/logarch.tex index ef792a8..6baad8d 100644 --- a/report/logarch.tex +++ b/report/logarch.tex @@ -1,7 +1,13 @@ \begin{figure} \begin{center} -\includegraphics[width = 6.0in, height = 2.6in]{img/Diagram2.png} +\includegraphics[width = 6.0in, height = 2.6in]{img/Logarch_part1.png} +\end{center} +\caption{} +\end{figure} +\begin{figure} +\begin{center} +\includegraphics[width = 4.5in, height = 1in]{img/Logarch_part2.png} \end{center} \caption{} \end{figure} diff --git a/report/logarch/clients.tex b/report/logarch/clients.tex index 144573a..4af04db 100644 --- a/report/logarch/clients.tex +++ b/report/logarch/clients.tex @@ -32,7 +32,9 @@ dealing with protocol implementation are located in the \textit{Core/} directory \item print\_timestamp.sh - add time and date information in all \textit{print} instructions, in the files listed in a file given as argument. \item set\_DEBUG.sh - sets DEBUG flag to a given value, in the files listed in file given as argument. \item set\_DEBUG\_NORMAL.sh - sets DEBUG\_NORMAL flag to a given value, in the files listed in file given as argument. -\item modify\_Connecter.sh - redirect print instructions to stderr in \textit{Core/BitTornado/BT1/Connecter.py} +\item modify\_Connecter.sh - redirect print instructions to stderr in + +\textit{Core/BitTornado/BT1/Connecter.py} \item make\_changes.sh - uses the above described scripts to make all the necessary changes \item undo\_changes.sh - uses the above described scripts to undo all the changes made, except the redirection of prints in \textit{Connecter.py} \end{enumerate} diff --git a/report/logarch/parser.tex b/report/logarch/parser.tex index e996f31..110b6a9 100644 --- a/report/logarch/parser.tex +++ b/report/logarch/parser.tex @@ -5,17 +5,43 @@ verbose information, which use the database communication methods discussed in s the parsed data in the database. All these scripts receive as arguments a client id corresponding to a row in \textit{clients} table, the log file -and the database. +and the database. An instance of DatabaseCommander checks the \textit{client\_id} and an instance of DatabaseWriter based on the \textit{database} argument is used to write the messages information (timestamp, message type etc). + \subsubsection {Tribler logs parsing} [TODO] -Example of a status line (shown here split into two line): + +Example of a status line (shown here split into two lines): \begin{verbatim} 03-Nov-2009 12:18:55 aqua.mpeg DLSTATUS_DOWNLOADING 29.84% None up 0.00KB/s down 4414.39KB/s eta 12 peers 2 \end{verbatim} + +The verbose parser searches a given log for the following bit torrent messages taking into consideration +the direction of the message, that indicated if it is received or send from/to a peer: + \begin{itemize} + \item BT\_REQUEST - both directions + \item BT\_CHOKE - receive direction + \item BT\_UNCHOKE - receive direction + \item BT\_HAVE - receive direction + \item BT\_PIECE - receive direction + \item BT\_BITFIELD - receive direction + \item BT\_CANCEL - send direction + \item BT\_INTERESTED -receive direction + \end{itemize} + Examples of protocol message lines: -[TODO] +\begin{verbatim} + 20-10-2009 12:56:39 Downloader: new_request 52 98304 16384 to 141.85.37.41 14398 + 27-11-2009 18:01:22 connecter: Got REQUEST( 1218 ) from 87.0.15.75 + 14-11-2009 23:11:13 connecter: Got PIECE( 141 ) from 141.85.37.41 + 14-11-2009 23:11:24 sent cancel: 130: 114688-131072 +\end{verbatim} + +Due to the many types of messages and their high frequency of being transmitted, the verbose log file can get to +large sizes of hundreds of MB, even a few GB. Therefore parsing such files demands much time than parsing the status log, +on our test files, getting to 20-30 minutes for logs of approximately 300MB on dual core 2GHz processors, 2G RAM. + diff --git a/report/report.tex b/report/report.tex index 54fadeb..11ebe61 100644 --- a/report/report.tex +++ b/report/report.tex @@ -8,11 +8,12 @@ \title{An Extensive Reporting, Storage and Analysis Infrastructure for BitTorrent} -\author{Adriana Draghici, Sandu Popa Marius, Razvan Deaconescu\\ +\author{Adriana Draghici, Marius Sandu-Popa, Razvan Deaconescu, Nicolae \c{T}apu\c{s}\\ University Politehnica of Bucharest\\ Computer Science and Engineering Department \\ Splaiul Independen\c{t}ei nr. 313, Bucharest, Romania \\ - \emph{\{adriana.draghici, marius.sandupopa\}}@cti.pub.ro, razvan.deaconescu@cs.pub.ro \\ + \emph{\{adriana.draghici, marius.sandupopa\}}@cti.pub.ro \\ + \emph{\{razvan.deaconescu, ntapus\}}@cs.pub.ro \\ } \date{February 11, 2010}