Display progress of a long running Python task in Django -


i have typical django structure set project , 1 web application.

the web application set user inputs information, , information taken input run python program.

this python program can take quite while finish (grabbing things web , doing text mining scoring) - can take multiple minutes load.

on command line, program periodically display in process (it'd first how many things found score against, it'd in number of things found in scoring process), useful. however, when moved on django set up, no longer have capability (at least, not in same way since sent log files).

the way set there input view, , results view. results view takes input , runs python program. won't display results until entire program run. on user side, browser sits there minutes before results displayed. obviously, not ideal.

does know of best way bring status information on task django?

i've looked celery little bit, think since i'm still beginner in django i'm confusing myself of documentation. instance: if task sent off asynchronously worker, how browser grab current state of program?? also, consistent documentation seems lacking celery on django (i've seen people set celery many different ways on django projects).

i appreciate input here, i've been stuck on while now.

my first suggestion psychologically separate celery django when start think of two. can run in same environment, celery asynchronous processes django http requests.

also remember celery unlike diango in requires other services function; message broker. using celery increase architectural requirements.

to address specific use case, you'll need system publish messages each celery task message broker , web client need subscribe messages.

there's lot involved here, short version can use redis celery message broker pub/sub service messages browser. can use e.g diango-redis-websockets subscribe browser task state messages in redis


Comments

Post a Comment

Popular posts from this blog

java - Spring Data JPA: Why findOne(id) executing delete query internally? -

i have 1 application using @manytomany annotation link 2 different entities 1 parent entity. not sure if have implemented properly. when execute .findone() on parent entity's repository find it, @ first fetch data along executing delete queries internally delete record mapping table (a table jpa creates after adding @manytomany annotation.). following generated sql queries , code snippet: java class @entity @table(name = "inventory") public class inventory { @id long id; // many other properties @manytomany(fetch=fetchtype.lazy) private list<stream> streams; @manytomany(fetch=fetchtype.lazy) private list<subject> subjects; } there no other annotation i've put in stream , subject entity class link inventory class. when run app, create following tables: inventory stream subject inventory_stream inventory_subject (inventory_stream , inventory_subject, 2 tables created automatically, don't k...
Read more

python - Mongodb How to add addtional information when aggregating? -

i beginner , wrote line pipeline works, wanna add other information output, screen name , or number of tweets.i tried add under $group gave me syntax error everytime here pipeline: def make_pipeline(): # complete aggregation pipeline pipeline = [ { '$match': { "user.statuses_count": {"$gt":99 }, "user.time_zone": "brasilia" } }, { "$group": { "_id": "$user.id", "followers": { "$max": "$user.followers_count" } } }, { "$sort": { "followers": -1 } }, { "$limit" : 1 } ]; i using on example : { "_id" : objectid("5304e2e3cc9e684aa98bef97"), "text" : "first week of school on :p", "in_reply_to_status_id" : null, "retweet_count" : null, ...
Read more

java - Incorrect order of records in M-M relationship in hibernate -

Image
i have 4 records in bridge table in mysql database. using @manytomany in hibernate, accurate order of employees incorrect incorrect of projects. following required material figure out doing mistake. this source. @entity @table(name="project") public class projectbean { @id @generatedvalue @column(name="project_id") private int projectid; @column(name="title") private string projecttitle; @manytomany(mappedby="projects") private collection<employeebean> employees; public projectbean() { employees = new arraylist<employeebean>(); } //getters & setters } @entity @table(name="employee") public class employeebean { @id @generatedvalue @column(name="employee_id") private int employee_id; @column(name="first_name") private string ...
Read more