Non Blocking File Read in PHP -

-

i implementing script read data file in php. contains around 30 thousand lines. problem facing takes lot of time server read file , echo results , send page. there way server can send response after given time, 2 seconds.

the result should contain part of file has been processed , in next reply should send part in processed in next 2 seconds.

there couple of approaches this:

1) implement loop in @barmar's answer save current position between requests/responses.

the problem @barmar's approach reads first chunk of file , returns it. it's not clear rest of file. 1 way improve processing via series of requests. example:

  • client makes request http://example.com/process?file_position=0

  • server starts processing @ position 0 responds data first part of file , new file position

  • client makes request http://example.com/process?file_position=1000

  • server reads new position wherever gets in 2 seconds , replies again

  • ...

2) use queue processing system file reading in background , use ajax (or websockets) send periodic updates client.

you can queue system execute long-running jobs in background , implement that. i'm using laravel application , has nice queue system - basically, have worker task running on server waits jobs queued up, executes them. see these docs idea of how works in laravel. may able roll own using combination of packages packagist.

the problem stems php's lack of multithreading support - not possible* spawn new process reading , return data client. long-running tasks either run php's execution time limit or user's browser sits there & spins long time.

* aware there techniques doing this, tend hacks.


Comments

Post a Comment

Popular posts from this blog

python - TypeError: start must be a integer -

-
i trying draw 5 turtles, getting typeerror on line 25. here code: import turtle wn = turtle.screen() redrose = turtle.turtle() color = input("what background color be?") fillcolor_f = input("what color of rose be?") redrose.hideturtle() redrose.speed(30) redrose.penup() redrose.left(180) redrose.forward(175) redrose.right(90) redrose.forward(30) redrose.right(90) redrose.pendown() def drawrose(red): redrose.color("pink") redrose.fillcolor(fillcolor_f) redrose.fill(true) in range(red): redrose.forward(i) redrose.right(49) in range(5): drawrose(redrose) redrose.penup() redrose.forward(350) redrose.right(144) redrose.pendown() redrose.fill(false) drawrose(50) wn.bgcolor(color) i trying draw 5 roses, produces errors. doing in interactivepython.org. you recursively calling drawrose wrong parameter. on line 23 ( for in range(red): ) expect red integer...
Read more

c# - DevExpress RepositoryItemComboBox BackColor property ignored -

-
i have following code almost works properly; private void cbstatus_drawitem(object sender, listboxdrawitemeventargs e) { string item = e.item string; if (item != null) { switch (item) { case "1": e.appearance.forecolor = color.green; e.appearance.backcolor = color.green; break; case "2": e.appearance.forecolor = color.orange; e.appearance.backcolor = color.orange; break; case "3": e.appearance.forecolor = color.red; e.appearance.backcolor = color.red; break; } } } when dropdown shown, items forecolor correct, backcolor remains whatever backcolor of theme is; i.e. if i've got set dark theme, backcolor dark, cells in gridview, rather being green/orange/red. i've tried setting e.appearance.options.usebackcolor trying set e....
Read more

django - Creating multiple model instances in DRF3 -

-
1) create multiple model instances 1 api call, asked here: how create multiple model instances django rest framework? tried solution named in link, no success. i trying upload multiple files in 1 api call. result: files uploaded (only once overwrote perform_create) 1 instance created (if send 2 files, latter created instance). my code: class fileuploadserializer(serializers.modelserializer): def __init__(self, *args, **kwargs): many = kwargs.pop('many', true) super(fileuploadserializer, self).__init__(many=many, *args, **kwargs) class meta: model = fileupload read_only_fields = ('created', 'datafile', 'owner') class fileuploadviewset(viewsets.modelviewset): queryset = fileupload.objects.all() serializer_class = fileuploadserializer parser_classes = (multipartparser, formparser, ) def perform_create(self, serializer): file_list = self.request.data.getlist('file') ...
Read more