c# - Most efficient (& fastest) way to query a list -

-

i'm trying work out performant way query list. know there ton of examples out there , has come loads before, i'm new , i'm struggling how apply of concepts situation.

private static void keepmatchesbasedonrestrictions(ref list<entity> matches,          list<entity> prefilteredshifts, list<entity> locationalinformations)     {         if (matches.count == 0) return;          matches.removeall(              (match) => ( geographyhasrestriction(match, prefilteredshifts, locationalinformations) )              );     }  private static bool geographyhasrestriction(entity match, list<entity> prefilteredshifts, list<entity> locationalinformations)     {                           entityreference fw = match.getattributevalue<entityreference>("crm_fw");          entity shift = prefilteredshifts.single<entity>(                  => match.getattributevalue<entityreference>("crm_shift").id == a.id             );         entityreference trust = shift.getattributevalue<entityreference>("crm_trust");         entityreference location = shift.getattributevalue<entityreference>("crm_location");         entityreference ward = shift.getattributevalue<entityreference>("crm_ward");          dictionary<guid, entity> locinforecs = locationalinformations.todictionary(p => p.id);          var locationalinformationquery = loc in locationalinformations                                          (                                             (                                                 loc.getattributevalue<entityreference>("crm_fw").id == fw.id                                                 && !loc.contains("crm_trust")                                                 && !loc.contains("crm_location")                                                 && !loc.contains("crm_ward")                                             )                                             ||                                             (                                                 loc.getattributevalue<entityreference>("crm_fw").id == fw.id                                                 && loc.getattributevalue<entityreference>("crm_trust").id == trust.id                                                 && !loc.contains("crm_location")                                                 && !loc.contains("crm_ward")                                             )                                             ||                                             (                                                 loc.getattributevalue<entityreference>("crm_fw").id == fw.id                                                 && loc.getattributevalue<entityreference>("crm_trust").id == trust.id                                                 && loc.getattributevalue<entityreference>("crm_location").id == location.id                                                 && !loc.contains("crm_ward")                                             )                                             ||                                             (                                                 loc.getattributevalue<entityreference>("crm_fw").id == fw.id                                                 && loc.getattributevalue<entityreference>("crm_trust").id == trust.id                                                 && loc.getattributevalue<entityreference>("crm_location").id == location.id                                                 && loc.getattributevalue<entityreference>("crm_ward").id == ward.id                                             )                                          )                                          select loc;          foreach (entity loc in locationalinformationquery)         {             if (loc.getattributevalue<bool>("crm_hasrestriction"))             {                 return true;             }         }          //return false;     }

so think problem 2-fold;

  1. the locationalinformationquery query seems run slowly... i'm talking in region of 2 seconds per iteration horrible.
  2. i suspect approach of calling matches.removeall() flawed due performance issues regarding lists.

so in terms of addressing this, think may able better performance converting locationalinformations list other type of container such dictionary, hashset or sortedlist. problem have no idea how go adjusting query to take advantage of more efficient containers.

as far second point goes, i'd curious hear alternatives using list.removeall(). have flexibility modify incoming container types within reason may viable.

with regards list sizes in case of use, match contains few thousand items , prefilteredshifts , locationalinformations each contain > 100,000 items.

as aside i've tried using parallel.foreach instead of foreach, made virtually no difference whatsoever.

edit: clarify questions, i'm doing in memory. i've populated of lists there shouldn't additional round trips db. i'm reasonably getattributevalue<entityreference> doesn't initial further db overhead.

also, yes local application calling dynamics crm online.

the code - 

foreach (entity loc in locationalinformationquery)     {         if (loc.getattributevalue<bool>("crm_hasrestriction"))         {             return true;         }     }

can 1 reason slowness. fetching more data , enumerating them in memory. can perform check directly before fetch, fetch lesser data , faster. - 

return (from loc in locationalinformations                                      ((                                         (                                             loc.getattributevalue<entityreference>("crm_fw").id == fw.id                                             && !loc.contains("crm_trust")                                             && !loc.contains("crm_location")                                             && !loc.contains("crm_ward")                                         )                                         ||                                         (                                             loc.getattributevalue<entityreference>("crm_fw").id == fw.id                                             && loc.getattributevalue<entityreference>("crm_trust").id == trust.id                                             && !loc.contains("crm_location")                                             && !loc.contains("crm_ward")                                         )                                         ||                                         (                                             loc.getattributevalue<entityreference>("crm_fw").id == fw.id                                             && loc.getattributevalue<entityreference>("crm_trust").id == trust.id                                             && loc.getattributevalue<entityreference>("crm_location").id == location.id                                             && !loc.contains("crm_ward")                                         )                                         ||                                         (                                             loc.getattributevalue<entityreference>("crm_fw").id == fw.id                                             && loc.getattributevalue<entityreference>("crm_trust").id == trust.id                                             && loc.getattributevalue<entityreference>("crm_location").id == location.id                                             && loc.getattributevalue<entityreference>("crm_ward").id == ward.id                                         )                                      ) && loc.getattributevalue<bool>("crm_hasrestriction")) // check before fetch in here                                      select loc).any();

Comments

Post a Comment

Popular posts from this blog

python - TypeError: start must be a integer -

-
i trying draw 5 turtles, getting typeerror on line 25. here code: import turtle wn = turtle.screen() redrose = turtle.turtle() color = input("what background color be?") fillcolor_f = input("what color of rose be?") redrose.hideturtle() redrose.speed(30) redrose.penup() redrose.left(180) redrose.forward(175) redrose.right(90) redrose.forward(30) redrose.right(90) redrose.pendown() def drawrose(red): redrose.color("pink") redrose.fillcolor(fillcolor_f) redrose.fill(true) in range(red): redrose.forward(i) redrose.right(49) in range(5): drawrose(redrose) redrose.penup() redrose.forward(350) redrose.right(144) redrose.pendown() redrose.fill(false) drawrose(50) wn.bgcolor(color) i trying draw 5 roses, produces errors. doing in interactivepython.org. you recursively calling drawrose wrong parameter. on line 23 ( for in range(red): ) expect red integer...
Read more

c# - DevExpress RepositoryItemComboBox BackColor property ignored -

-
i have following code almost works properly; private void cbstatus_drawitem(object sender, listboxdrawitemeventargs e) { string item = e.item string; if (item != null) { switch (item) { case "1": e.appearance.forecolor = color.green; e.appearance.backcolor = color.green; break; case "2": e.appearance.forecolor = color.orange; e.appearance.backcolor = color.orange; break; case "3": e.appearance.forecolor = color.red; e.appearance.backcolor = color.red; break; } } } when dropdown shown, items forecolor correct, backcolor remains whatever backcolor of theme is; i.e. if i've got set dark theme, backcolor dark, cells in gridview, rather being green/orange/red. i've tried setting e.appearance.options.usebackcolor trying set e....
Read more

django - Creating multiple model instances in DRF3 -

-
1) create multiple model instances 1 api call, asked here: how create multiple model instances django rest framework? tried solution named in link, no success. i trying upload multiple files in 1 api call. result: files uploaded (only once overwrote perform_create) 1 instance created (if send 2 files, latter created instance). my code: class fileuploadserializer(serializers.modelserializer): def __init__(self, *args, **kwargs): many = kwargs.pop('many', true) super(fileuploadserializer, self).__init__(many=many, *args, **kwargs) class meta: model = fileupload read_only_fields = ('created', 'datafile', 'owner') class fileuploadviewset(viewsets.modelviewset): queryset = fileupload.objects.all() serializer_class = fileuploadserializer parser_classes = (multipartparser, formparser, ) def perform_create(self, serializer): file_list = self.request.data.getlist('file') ...
Read more