csv - UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 7240: character maps to <undefined> -

-

i student doing master thesis. part of thesis, working python. reading log file of .csv format , writing extracted data .csv file in formatted way. however, when file read, getting error:

traceback (most recent call last): file "c:\users\sgadi\workspace\dab_trace\my_code\trace_parcer.py", line 19, in row in reader:

  • file "c:\users\sgadi\desktop\python-32bit-3.4.3.2\python-3.4.3\lib\encodings\cp1252.py", line 23, in decode return codecs.charmap_decode(input,self.errors,decoding_table)[0]
  • unicodedecodeerror: 'charmap' codec can't decode byte 0x8d in position 7240: character maps <undefined>
import csv import re #import matplotlib #import matplotlib.pyplot plt import datetime #import pandas #from dateutil.parser import parse #def parse_csv_file(): timestamp = datetime.datetime.strptime('00:00:00.000', '%h:%m:%s.%f') timestamp_list = [] snr_list = [] freq_list = [] rssi_list = [] dab_present_list = [] counter = 0 f =  open("output.txt","w") open('test_log_20150325_gps.csv') csvfile:     reader = csv.reader(csvfile, delimiter=';')      row in reader:         #timestamp = datetime.datetime.strptime(row[0], '%m:%s.%f')         #timestamp.split(" ",1)          timestamp = row[0]         timestamp_list.append(timestamp)           #timestamp = row[0]         details = row[-1]         counter += 1         print (counter)         #if(counter > 25000):         #  break         #timestamp = datetime.datetime.strptime(row[0], '%m:%s.%f')              #timestamp_list.append(float(timestamp))          #search snrlevel=\d+         snr = re.findall('snrlevel=(\d+)', details)         if snr == []:             snr = 0         else:             snr = snr[0]         snr_list.append(int(snr))          #search frequency=09abc         freq = re.findall('frequency=([0-9a-fa-f]+)', details)         if freq == []:             freq = 0         else:             freq = int(freq[0], 16)         freq_list.append(int(freq))          #search rssi=\d+         rssi = re.findall('rssi=(\d+)', details)         if rssi == []:             rssi = 0         else:             rssi = rssi[0]         rssi_list.append(int(rssi))          #search dabsignalpresent=\d+         dab_present = re.findall('dabsignalpresent=(\d+)', details)         if dab_present== []:             dab_present = 0         else:             dab_present = dab_present[0]         dab_present_list.append(int(dab_present))          f.write(str(timestamp) + "\t")         f.write(str(freq) + "\t")         f.write(str(snr) + "\t")         f.write(str(rssi) + "\t")         f.write(str(dab_present) + "\n")         print (timestamp, freq, snr, rssi, dab_present)          #print (index+1)          #print(timestamp,freq,snr)         #print (counter) #print(timestamp_list,freq_list,snr_list,rssi_list)   '''if  snr != []:            if freq != []:                timestamp_list.append(timestamp)                snr_list.append(snr)                freq_list.append(freq) f.write(str(timestamp_list) + "\t") f.write(str(freq_list) + "\t") f.write(str(snr_list) + "\n")  print(timestamp_list,freq_list,snr_list)''' f.close()

i searched special character , did not find any. searched internet suggested change format: tried ut8, latin1 , few other formats, still getting error. can please me how solve pandas well. tried pandas still getting error. removed line in log file, error occurs in next line.

please me finding solution, thank you.

i have solved issue. can use code

import codecs types_of_encoding = ["utf8", "cp1252"] encoding_type in types_of_encoding:     codecs.open(filename, encoding = encoding_type, errors ='replace') csvfile:         code         ....         ....

Comments

Post a Comment

Popular posts from this blog

python - TypeError: start must be a integer -

-
i trying draw 5 turtles, getting typeerror on line 25. here code: import turtle wn = turtle.screen() redrose = turtle.turtle() color = input("what background color be?") fillcolor_f = input("what color of rose be?") redrose.hideturtle() redrose.speed(30) redrose.penup() redrose.left(180) redrose.forward(175) redrose.right(90) redrose.forward(30) redrose.right(90) redrose.pendown() def drawrose(red): redrose.color("pink") redrose.fillcolor(fillcolor_f) redrose.fill(true) in range(red): redrose.forward(i) redrose.right(49) in range(5): drawrose(redrose) redrose.penup() redrose.forward(350) redrose.right(144) redrose.pendown() redrose.fill(false) drawrose(50) wn.bgcolor(color) i trying draw 5 roses, produces errors. doing in interactivepython.org. you recursively calling drawrose wrong parameter. on line 23 ( for in range(red): ) expect red integer...
Read more

c# - DevExpress RepositoryItemComboBox BackColor property ignored -

-
i have following code almost works properly; private void cbstatus_drawitem(object sender, listboxdrawitemeventargs e) { string item = e.item string; if (item != null) { switch (item) { case "1": e.appearance.forecolor = color.green; e.appearance.backcolor = color.green; break; case "2": e.appearance.forecolor = color.orange; e.appearance.backcolor = color.orange; break; case "3": e.appearance.forecolor = color.red; e.appearance.backcolor = color.red; break; } } } when dropdown shown, items forecolor correct, backcolor remains whatever backcolor of theme is; i.e. if i've got set dark theme, backcolor dark, cells in gridview, rather being green/orange/red. i've tried setting e.appearance.options.usebackcolor trying set e....
Read more

django - Creating multiple model instances in DRF3 -

-
1) create multiple model instances 1 api call, asked here: how create multiple model instances django rest framework? tried solution named in link, no success. i trying upload multiple files in 1 api call. result: files uploaded (only once overwrote perform_create) 1 instance created (if send 2 files, latter created instance). my code: class fileuploadserializer(serializers.modelserializer): def __init__(self, *args, **kwargs): many = kwargs.pop('many', true) super(fileuploadserializer, self).__init__(many=many, *args, **kwargs) class meta: model = fileupload read_only_fields = ('created', 'datafile', 'owner') class fileuploadviewset(viewsets.modelviewset): queryset = fileupload.objects.all() serializer_class = fileuploadserializer parser_classes = (multipartparser, formparser, ) def perform_create(self, serializer): file_list = self.request.data.getlist('file') ...
Read more