{"id":1075,"date":"2013-08-14T13:18:34","date_gmt":"2013-08-14T12:18:34","guid":{"rendered":"http:\/\/www.phillips321.co.uk\/?p=1075"},"modified":"2013-08-14T13:18:34","modified_gmt":"2013-08-14T12:18:34","slug":"md5checker-py-allows-checking-of-file-changes-in-a-directory","status":"publish","type":"post","link":"https:\/\/www.phillips321.co.uk\/2013\/08\/14\/md5checker-py-allows-checking-of-file-changes-in-a-directory\/","title":{"rendered":"md5checker.py – Allows checking of file changes in a directory"},"content":{"rendered":"

So I wanted a quick way to create an MD5 sum of all the files recursively in a directory so i wrote a quick python script to do this.<\/p>\n

Basically run the python file and provide the directory you want to check. This will create a new txt file named md5sYYYY-MM-DD-HHMM.txt containing a list of the files found along with their md5sums.<\/p>\n

Then to check the the files run it again but provide the file instead of the directory.
\n\"md5checker\"<\/a><\/p>\n

It will also report if a file has been deleted.<\/p>\n

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
<\/div><\/td>
#!\/usr\/bin\/env python<\/span>
\n# md5checker.py<\/span>
\n# version 1.0<\/span>
\n# www.phillips321.co.uk<\/span>
\nimport<\/span> os<\/span>,<\/span>hashlib,<\/span>time<\/span>,<\/span>sys<\/span>
\n
\ndef<\/span> md5_file(<\/span>file<\/span>,<\/span> block_size=<\/span>2<\/span>**20<\/span>)<\/span>:
\n    try<\/span>:
\n        f=<\/span>open<\/span>(<\/span>file<\/span>,<\/span>'r'<\/span>)<\/span>
\n        md5<\/span> =<\/span> hashlib.md5<\/span>(<\/span>)<\/span>
\n        for<\/span> chunk<\/span> in<\/span> iter<\/span>(<\/span>lambda<\/span>: f.read<\/span>(<\/span>8192<\/span>)<\/span>,<\/span> b''<\/span>)<\/span>:
\n            md5<\/span>.update<\/span>(<\/span>chunk<\/span>)<\/span>
\n        f.close<\/span>(<\/span>)<\/span>
\n        return<\/span> md5<\/span>.hexdigest<\/span>(<\/span>)<\/span>
\n    except<\/span>:
\n        return<\/span> None<\/span>
\n
\ndef<\/span> checkhashes(<\/span>)<\/span>:
\n    allgood=<\/span>0<\/span>
\n    print<\/span> "[+]Scanning files from hashfile %s"<\/span> % sys<\/span>.argv<\/span>[<\/span>1<\/span>]<\/span>
\n    hashfile=<\/span>open<\/span>(<\/span>sys<\/span>.argv<\/span>[<\/span>1<\/span>]<\/span>,<\/span>'r'<\/span>)<\/span>
\n    for<\/span> line in<\/span> hashfile.readlines<\/span>(<\/span>)<\/span>:
\n        oldhash,<\/span>file<\/span>=<\/span>line.strip<\/span>(<\/span>)<\/span>.split<\/span>(<\/span>','<\/span>)<\/span>
\n        if<\/span> os<\/span>.path<\/span>.basename<\/span>(<\/span>file<\/span>)<\/span>.startswith<\/span>(<\/span>"md5s"<\/span>)<\/span> ==<\/span> True<\/span> : continue<\/span>
\n        actualhash=<\/span>md5_file(<\/span>file<\/span>)<\/span>
\n        if<\/span> actualhash==<\/span>None<\/span>:
\n            print<\/span> "[!]File has been deleted: %s"<\/span> % file<\/span>
\n        elif<\/span> oldhash !=<\/span> actualhash:
\n            print<\/span> "[!]File has changed: %s"<\/span> % file<\/span>
\n            print<\/span> "   Old chesksum:"<\/span> + oldhash
\n            print<\/span> "   New checksum:"<\/span> + actualhash
\n            allgood+=<\/span>1<\/span>
\n    hashfile.close<\/span>(<\/span>)<\/span>
\n    if<\/span> allgood ==<\/span> 0<\/span>: print<\/span> "[+]No files changes"<\/span>
\n    else<\/span>: print<\/span> "[!] %d file's has been changed!"<\/span> % allgood
\n
\ndef<\/span> makehashes(<\/span>)<\/span>:
\n    filename=<\/span>"md5s"<\/span>+time<\/span>.strftime<\/span>(<\/span>"%Y-%m-%d-%H%M"<\/span>)<\/span>+".txt"<\/span>
\n    print<\/span> "[+]No hashfile provided, creating new list\\n<\/span>-->"<\/span> + filename
\n    hashfile=<\/span>open<\/span>(<\/span>filename,<\/span> "w+"<\/span>)<\/span>
\n    for<\/span> path,<\/span> subFolders,<\/span> files in<\/span> os<\/span>.walk<\/span>(<\/span>dir<\/span>)<\/span>:
\n        for<\/span> file<\/span> in<\/span> files:
\n            sys<\/span>.stdout<\/span>.write<\/span>(<\/span>"    [-]"<\/span>+os<\/span>.path<\/span>.join<\/span>(<\/span>path,<\/span>file<\/span>)<\/span>)<\/span>
\n            hash<\/span>=<\/span>md5_file(<\/span>os<\/span>.path<\/span>.join<\/span>(<\/span>path,<\/span>file<\/span>)<\/span>)<\/span>
\n            print<\/span> " - "<\/span> + hash<\/span>
\n            hashfile.write<\/span>(<\/span>hash<\/span>+","<\/span>+os<\/span>.path<\/span>.join<\/span>(<\/span>os<\/span>.path<\/span>.abspath<\/span>(<\/span>path)<\/span>,<\/span>file<\/span>+"\\n<\/span>"<\/span>)<\/span>)<\/span>
\n    hashfile.close<\/span>(<\/span>)<\/span>
\n
\ntry<\/span>:
\n    dir<\/span>=<\/span>os<\/span>.path<\/span>.join<\/span>(<\/span>sys<\/span>.argv<\/span>[<\/span>1<\/span>]<\/span>)<\/span> #directory provided<\/span>
\nexcept<\/span>:
\n    dir<\/span>=<\/span>os<\/span>.getcwd<\/span>(<\/span>)<\/span> #no directory provided (use current working dir)<\/span>
\n
\nif<\/span> os<\/span>.path<\/span>.isfile<\/span>(<\/span>os<\/span>.path<\/span>.join<\/span>(<\/span>dir<\/span>)<\/span>)<\/span> ==<\/span> True<\/span>: #file provided, run checkhashes<\/span>
\n    os<\/span>.path<\/span>.isfile<\/span>(<\/span>os<\/span>.path<\/span>.join<\/span>(<\/span>dir<\/span>)<\/span>)<\/span>
\n    checkhashes(<\/span>)<\/span>
\nelse<\/span>:
\n    #directory provided, run makehashes<\/span>
\n    makehashes(<\/span>)<\/span><\/div><\/td><\/tr><\/tbody><\/table><\/div>\n","protected":false},"excerpt":{"rendered":"

So I wanted a quick way to create an MD5 sum of all the files recursively in a directory so i wrote a quick python script to do this. Basically run the python file and provide the directory you want to check. This will create a new txt file named md5sYYYY-MM-DD-HHMM.txt containing a list of […]<\/p>\n","protected":false},"author":1,"featured_media":1077,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[388,205,389,111],"_links":{"self":[{"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/posts\/1075"}],"collection":[{"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/comments?post=1075"}],"version-history":[{"count":1,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/posts\/1075\/revisions"}],"predecessor-version":[{"id":1078,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/posts\/1075\/revisions\/1078"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/media\/1077"}],"wp:attachment":[{"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/media?parent=1075"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/categories?post=1075"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.phillips321.co.uk\/wp-json\/wp\/v2\/tags?post=1075"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}