c# - Dealing with OutOfMemory Exception -

-

is there proper way deal out of memory exceptions while looping through large list , adding objects list? proper way go doing this? have large linq query returns around 600k items. go through each item , add object. code below.

  static void main(string[] args)     {         grabdata();     }      public static void grabdata()     {         decimal? totalnetclaim = 0;         using (var context = new vscmesnapentities())         {                           list<drivetimeobject> datafile = new list<drivetimeobject>();              drivetimeobject dt = new drivetimeobject();             datetime paramdate = new datetime(2015, 05, 30);             list<viewdrivetimefiledump> dataquery = new list<viewdrivetimefiledump>();              dataquery = (from z in context.viewdrivetimefiledumps select z).tolist();              foreach (var item in dataquery)             {                 decimal? amountchargedparts = dt.getamountchargedparts(item.chrcomponsts.trim(), item.mnstotalparts);                 decimal? amountchargedpartstax = dt.getamountchargedpartstax(item.chrcomponsts.trim(), item.mnstotalparttax);                 decimal? amountchargedlabor = dt.getamountchargedlabor(item.chrcomponsts.trim(), item.mnstotallabor);                 decimal? amountchargedlabortax = dt.getamountchargedlabortax(item.chrcomponsts.trim(), item.mnstotallabortax);                 int? daysout = dt.getdaysoutclaim(item.intrepairfacilcode, item.dtmcontpurchdate, item.dtmreported);                 long? milesout = dt.getmilesoutclaim(item.intrepairfacilcode, item.inbincurmiles, item.inborigmiles);                 decimal? deductible = dt.getdeductible(item.chrcontsts, item.mnsdeduct);                 decimal? netclaim = dt.getnetclaim(item.chrcomponsts.trim(), item.mnstotalparts, item.mnstotalparttax, item.mnstotallabor, item.mnstotallabortax, item.mnsdeduct);                  datafile.add(new drivetimeobject                 {                     dealernumber = item.chrdlrnum,                     vscname = item.chvvscname,                     iclocationnumber = item.iclocationnumber,                     icregion = item.icregion,                     identifier = item.chridentifier,                     contractnumber = item.chrcontnum,                     vin = item.chrvin,                     coveragecode = item.cvgcode,                     claimnum = item.intclaimnum,                     originalmiles = item.inborigmiles,                     contractpurchasedate = item.dtmcontpurchdate,                     incurmiles = item.inbincurmiles,                     datereported = item.dtmreported,                     daysoutclaim = daysout,                     milesout = milesout,                     repairfacilitynumber = item.intrepairfacilcode,                     facilityname = item.chvfacilityname,                     zipfive = item.chrzipfive,                     facilityadvisor = item.chrfaciladvisor,                     componentstatus = item.chrcomponsts,                     componentstatusword = item.compondesc,                     componentcode = item.chrcomponcode,                     statusmasterdescription = item.masterdesc,                     componentdescription = item.chvcompondesc,                     parts = amountchargedparts,                     partstax = amountchargedpartstax,                     labor = amountchargedlabor,                     labortax = amountchargedlabortax,                     deductible = deductible,                     netclaim = netclaim,                     carriercode = item.intcarriercode,                     networkstatus = item.networkstatus,                     addon = item.chraddon,                     etcdate = item.etc,                     atcdate = item.atc,                     labortime = item.realabortime,                     paiddate = item.dtmpddate,                     paymentid = item.intpaymentid,                     batchnumber = item.intbatchnum                  });                  totalnetclaim += netclaim;             }             context.dispose();         }          console.writeline(totalnetclaim);         console.readkey();       }

i run out of memory during foreach loop , wondering how should go adjusting code make work.

the way prevent out of memory not run out of memory. means need rid of objects don't need.

without learning more of use case, hard suggest fix. regardless of that, it's bad practice have many objects in memory run out , crash. only keep in memory need.

one fix not use ram memory, , instead use hard drive memory. ex: can write objects database , rid of them, don't keep them around. considering have 600k objects, these in batches of 10k/25k records. when need objects, can query them. if need calculations objects, recommend doing operations using sql queries.


Comments

Post a Comment

Popular posts from this blog

python - TypeError: start must be a integer -

-
i trying draw 5 turtles, getting typeerror on line 25. here code: import turtle wn = turtle.screen() redrose = turtle.turtle() color = input("what background color be?") fillcolor_f = input("what color of rose be?") redrose.hideturtle() redrose.speed(30) redrose.penup() redrose.left(180) redrose.forward(175) redrose.right(90) redrose.forward(30) redrose.right(90) redrose.pendown() def drawrose(red): redrose.color("pink") redrose.fillcolor(fillcolor_f) redrose.fill(true) in range(red): redrose.forward(i) redrose.right(49) in range(5): drawrose(redrose) redrose.penup() redrose.forward(350) redrose.right(144) redrose.pendown() redrose.fill(false) drawrose(50) wn.bgcolor(color) i trying draw 5 roses, produces errors. doing in interactivepython.org. you recursively calling drawrose wrong parameter. on line 23 ( for in range(red): ) expect red integer...
Read more

c# - DevExpress RepositoryItemComboBox BackColor property ignored -

-
i have following code almost works properly; private void cbstatus_drawitem(object sender, listboxdrawitemeventargs e) { string item = e.item string; if (item != null) { switch (item) { case "1": e.appearance.forecolor = color.green; e.appearance.backcolor = color.green; break; case "2": e.appearance.forecolor = color.orange; e.appearance.backcolor = color.orange; break; case "3": e.appearance.forecolor = color.red; e.appearance.backcolor = color.red; break; } } } when dropdown shown, items forecolor correct, backcolor remains whatever backcolor of theme is; i.e. if i've got set dark theme, backcolor dark, cells in gridview, rather being green/orange/red. i've tried setting e.appearance.options.usebackcolor trying set e....
Read more

django - Creating multiple model instances in DRF3 -

-
1) create multiple model instances 1 api call, asked here: how create multiple model instances django rest framework? tried solution named in link, no success. i trying upload multiple files in 1 api call. result: files uploaded (only once overwrote perform_create) 1 instance created (if send 2 files, latter created instance). my code: class fileuploadserializer(serializers.modelserializer): def __init__(self, *args, **kwargs): many = kwargs.pop('many', true) super(fileuploadserializer, self).__init__(many=many, *args, **kwargs) class meta: model = fileupload read_only_fields = ('created', 'datafile', 'owner') class fileuploadviewset(viewsets.modelviewset): queryset = fileupload.objects.all() serializer_class = fileuploadserializer parser_classes = (multipartparser, formparser, ) def perform_create(self, serializer): file_list = self.request.data.getlist('file') ...
Read more