mirrors/etherpad-lite
1
0
Fork 0
mirror of https://github.com/ether/etherpad-lite.git synced 2025-04-20 15:36:16 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

Try/catch to skip invalid JSON in dirtyDB

Browse source
This commit is contained in:
Achim Friedland 2018-11-02 20:10:36 +01:00 • committed by muxator
parent 0443de4dc9
commit 5f836f6211
1 changed files with 5 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

3
bin/dirty-db-cleaner.py
View file

@ -31,8 +31,11 @@ with open(dirtydb_input, 'r') as fd:
print 'Reading %s' % dirtydb_input print 'Reading %s' % dirtydb_input
for line in fd: for line in fd:
lines += 1 lines += 1
try:
data = json.loads(line) data = json.loads(line)
dirtydb[data['key']] = line dirtydb[data['key']] = line
except:
print("Skipping invalid JSON!")
if lines % 10000 == 0: if lines % 10000 == 0:
sys.stderr.write('.') sys.stderr.write('.')
print print