Skip to content
Toggle navigation
Toggle navigation
This project
Loading...
Sign in
周伟奇
/
bmw-ocr
Go to a project
Toggle navigation
Toggle navigation pinning
Projects
Groups
Snippets
Help
Project
Activity
Repository
Graphs
Network
Create a new issue
Commits
Issue Boards
Files
Commits
Network
Compare
Branches
Tags
80b6584c
authored
2021-03-16 18:15:12 +0800
by
周伟奇
Browse Files
Options
Browse Files
Tag
Download
Email Patches
Plain Diff
add compare log
1 parent
149fb49b
Show whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
34 additions
and
13 deletions
src/apps/doc/management/commands/ocr_process.py
src/celery_compare/__init__.py
src/celery_compare/tasks.py
src/settings/conf/logging.conf
src/apps/doc/management/commands/ocr_process.py
View file @
80b6584
...
...
@@ -841,12 +841,6 @@ class Command(BaseCommand, LoggerMixin):
self
.
cronjob_log
.
error
(
'{0} [process error (completed)] [task={1}] [error={2}]'
.
format
(
self
.
log_base
,
task_str
,
traceback
.
format_exc
()))
# TODO 细化文件状态,不同异常状态,归还队列,重试时采取不同的处理
# TODO 异常邮件通知
# 识别失败:普通异常,如PDF异常、构建过程异常
# EDMS异常:下载异常-->回队列-->邮件;上传异常-->重新上传队列-->邮件
# 算法异常:第一道异常-->识别失败-->邮件;第二道异常-->识别失败-->邮件
def
handle
(
self
,
*
args
,
**
kwargs
):
db
.
close_old_connections
()
lock
=
Lock
()
...
...
src/celery_compare/__init__.py
View file @
80b6584
import
os
from
celery
import
Celery
from
settings
import
conf
os
.
environ
.
setdefault
(
'DJANGO_SETTINGS_MODULE'
,
'settings'
)
broker
=
conf
.
CELERY_BROKER_URL
app
=
Celery
(
'celery_compare'
,
broker
=
broker
,
include
=
[
'celery_compare.tasks'
])
...
...
src/celery_compare/tasks.py
View file @
80b6584
import
logging
from
.
import
app
from
apps.doc.models
import
AFCDoc
compare_log
=
logging
.
getLogger
(
'compare'
)
@app.task
def
test
(
info
):
print
(
info
)
doc
=
AFCDoc
.
objects
.
filter
(
id
=
1
)
.
first
()
compare_log
.
info
(
doc
.
id
)
compare_log
.
info
(
info
)
...
...
src/settings/conf/logging.conf
View file @
80b6584
[
loggers
]
keys
=
root
,
running
,
exception
,
cronjob
,
folder
,
bs
,
license
,
idcard
,
django
.
db
.
backends
;
online
--> 线上
OCR
日志:
ocr_process
.
py
;
folder
--> 线下
OCR
日志:
folder_ocr_process
.
py
;
bs
--> 线上流水识别结果日志,用于生成每日申请号-版式报表:
bs_statistics
.
py
;
license
--> 线上证件识别结果日志,用于偶尔生成结果报表:
license_statistics
.
py
;
idcard
--> 线上身份证识别结果日志,用于生成每日、每月身份证报表:
idcard_daily
.
py
、
idcard_monthly
.
py
;
compare
-->
celery
compare
日志
keys
=
root
,
running
,
exception
,
online
,
folder
,
bs
,
license
,
idcard
,
compare
,
django
.
db
.
backends
[
handlers
]
keys
=
consoleHandler
,
django_rotateFileHandler
,
exceptionFileHandler
,
cronjobFileHandler
,
folderFileHandler
,
bsFileHandler
,
licenseFileHandler
,
idcard
FileHandler
,
djangodbFileHandler
keys
=
consoleHandler
,
django_rotateFileHandler
,
exceptionFileHandler
,
onlineFileHandler
,
folderFileHandler
,
bsFileHandler
,
licenseFileHandler
,
idcardFileHandler
,
compare
FileHandler
,
djangodbFileHandler
[
formatters
]
keys
=
SituFormatter
,
dataLogFormatter
,
SimpleFormatter
...
...
@@ -37,7 +43,7 @@ level=ERROR
formatter
=
SituFormatter
args
=(
'../logs/exception.log'
,)
[
handler_
cronjob
FileHandler
]
[
handler_
online
FileHandler
]
class
=
situlogger
.
SituRotatingFileHandler
level
=
DEBUG
formatter
=
SituFormatter
...
...
@@ -67,6 +73,12 @@ level=DEBUG
formatter
=
SimpleFormatter
args
=(
'../logs/idcard.log'
,)
[
handler_compareFileHandler
]
class
=
situlogger
.
SituRotatingFileHandler
level
=
DEBUG
formatter
=
SituFormatter
args
=(
'../logs/compare.log'
,)
[
handler_djangodbFileHandler
]
class
=
situlogger
.
SituRotatingFileHandler
level
=
DEBUG
...
...
@@ -89,10 +101,10 @@ handlers=exceptionFileHandler
qualname
=
exception
propagate
=
0
[
logger_
cronjob
]
[
logger_
online
]
level
=
INFO
handlers
=
cronjob
FileHandler
qualname
=
cronjob
handlers
=
online
FileHandler
qualname
=
online
propagate
=
0
[
logger_folder
]
...
...
@@ -119,6 +131,12 @@ handlers=idcardFileHandler
qualname
=
idcard
propagate
=
0
[
logger_compare
]
level
=
INFO
handlers
=
compareFileHandler
qualname
=
compare
propagate
=
0
[
logger_django
.
db
.
backends
]
level
=
DEBUG
handlers
=
djangodbFileHandler
...
...
Write
Preview
Styling with
Markdown
is supported
Attach a file
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to post a comment