{"id":1086,"date":"2013-08-31T17:20:06","date_gmt":"2013-08-31T16:20:06","guid":{"rendered":"http:\/\/www.phillips321.co.uk\/?p=1086"},"modified":"2013-08-31T17:20:06","modified_gmt":"2013-08-31T16:20:06","slug":"multi-threading-python-a-quick-example","status":"publish","type":"post","link":"https:\/\/www.phillips321.co.uk\/2013\/08\/31\/multi-threading-python-a-quick-example\/","title":{"rendered":"Multi-threading python – a quick example"},"content":{"rendered":"

So in order to teach myself how to create multi-threaded python apps I decided to have a go this morning at writing a simple MD5 bruteforcer (using a wordlist).<\/p>\n

The way this works is that you create worker threads and each worker thread pulls an item from the queue and processes it; when finished it pulls another item from the queue and so on.<\/p>\n

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
<\/div><\/td>
#!\/usr\/bin\/env python<\/span>
\n# md5brute.py<\/span>
\n
\nimport<\/span> sys<\/span>,<\/span>Queue<\/span>,<\/span>threading<\/span>,<\/span>hashlib,<\/span>os<\/span>
\n
\nNumOfThreads=<\/span>100<\/span>  # Number of threads<\/span>
\nqueue =<\/span> Queue<\/span>.Queue<\/span>(<\/span>)<\/span>
\n
\n# get hash and wordlist input<\/span>
\ntry<\/span>:
\n    TargetHash=<\/span>sys<\/span>.argv<\/span>[<\/span>1<\/span>]<\/span>.lower<\/span>(<\/span>)<\/span>
\n    WordList=<\/span>open<\/span>(<\/span>sys<\/span>.argv<\/span>[<\/span>2<\/span>]<\/span>,<\/span>'r'<\/span>)<\/span>
\nexcept<\/span>:
\n    print<\/span> "Usage: %s hash wordlist"<\/span> % sys<\/span>.argv<\/span>[<\/span>0<\/span>]<\/span>
\n    sys<\/span>.exit<\/span>(<\/span>1<\/span>)<\/span>
\n
\nclass<\/span> checkHash(<\/span>threading<\/span>.Thread<\/span>)<\/span>:
\n    def<\/span> __init__<\/span>(<\/span>self<\/span>,<\/span>queue)<\/span>:
\n        threading<\/span>.Thread<\/span>.__init__<\/span>(<\/span>self<\/span>)<\/span>
\n        self<\/span>.queue<\/span>=<\/span>queue
\n    def<\/span> run(<\/span>self<\/span>)<\/span>:
\n        while<\/span> True<\/span>:
\n            self<\/span>.clear<\/span>=<\/span>self<\/span>.queue<\/span>.get<\/span>(<\/span>)<\/span>
\n            if<\/span> hashlib.md5<\/span>(<\/span>self<\/span>.clear<\/span>)<\/span>.hexdigest<\/span>(<\/span>)<\/span> ==<\/span> TargetHash:
\n                print<\/span> "Hash found!!! %s = %s"<\/span> % (<\/span>self<\/span>.clear<\/span>,<\/span>TargetHash)<\/span>
\n                os<\/span>._exit(<\/span>0<\/span>)<\/span>
\n            self<\/span>.queue<\/span>.task_done<\/span>(<\/span>)<\/span>
\n
\n#spawn a pool of threads<\/span>
\nfor<\/span> i in<\/span> range<\/span>(<\/span>NumOfThreads)<\/span>:
\n    t=<\/span>checkHash(<\/span>queue)<\/span>
\n    t.setDaemon<\/span>(<\/span>True<\/span>)<\/span>
\n    t.start<\/span>(<\/span>)<\/span>
\n
\n#populate queue with wordlist<\/span>
\nfor<\/span> word in<\/span> WordList.readlines<\/span>(<\/span>)<\/span>:
\n    queue.put<\/span>(<\/span>word.strip<\/span>(<\/span>)<\/span>)<\/span>
\n
\nqueue.join<\/span>(<\/span>)<\/span><\/div><\/td><\/tr><\/tbody><\/table><\/div>\n

We will try to crack the MD5 hash b0b129991a71c1ba6e8b6a280c5fbed2 using the rockyou wordlist.<\/p>\n

1
2
3
4
<\/div><\/td>
Matthews-MacBook-Pro:Desktop phillips321$ .\/md5brute.py
\nUsage: .\/md5brute.py hash wordlist
\nMatthews-MacBook-Pro:Desktop phillips321$ .\/md5brute.py b0b129991a71c1ba6e8b6a280c5fbed2 rockyou.txt
\nHash found!!! a6_123 = b0b129991a71c1ba6e8b6a280c5fbed2<\/div><\/td><\/tr><\/tbody><\/table><\/div>\n

Voila! It worked.<\/p>\n

What’s important to note here is that although python is running multiple threads it is only running on 1 core so it’s not making full use of the CPU.
\n\"Screen<\/a>
\n\"Screen<\/a>
\nIn order to fully utilise the multiple cores on the CPU I would need to use the multiprocessing module in python… but i’ll save that for another day.<\/p>\n","protected":false},"excerpt":{"rendered":"

So in order to teach myself how to create multi-threaded python apps I decided to have a go this morning at writing a simple MD5 bruteforcer (using a wordlist). The way this works is that you create worker threads and each worker thread pulls an item from the queue and processes it; when finished it […]<\/p>\n","protected":false},"author":1,"featured_media":1091,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[188,205,398,111,396,397],"_links":{"self":[{"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/posts\/1086"}],"collection":[{"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/comments?post=1086"}],"version-history":[{"count":6,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/posts\/1086\/revisions"}],"predecessor-version":[{"id":1095,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/posts\/1086\/revisions\/1095"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/media\/1091"}],"wp:attachment":[{"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/media?parent=1086"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/categories?post=1086"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/tags?post=1086"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}