Python has a lot of issues handling Unicode (there seem to be backwards compatibility issues – https:\/\/en.wikipedia.org\/wiki\/History_of_Python).<\/p>\n
One common error you get will look like this:<\/p>\n
\nTraceback (most recent call last):\n File \"D:\\Software\\Anaconda3\\lib\\encodings\\cp1252.py\", line 19, in encode\n return codecs.charmap_encode(input,self.errors,encoding_table)[0]\nUnicodeEncodeError: 'charmap' codec can't encode characters in position 777-778: character maps to\n<\/pre>\n If this occurs while you are doing an HTTP request, do this:<\/p>\n
\nhttpresponse = urlopen(url).read().decode('utf8')\nresponse = json.loads(httpresponse)\n<\/pre>\nIf this occurs while you are reading a file in Beautiful soup, do this (the ‘rb’ triggers binary mode):<\/p>\n
\nsoup = BeautifulSoup(open(file, 'rb'), 'html.parser')\n<\/pre>\nIf this occurs in a print statement, like so, you may need to start logging to a file1<\/a><\/sup>.<\/p>\n
\nprint u'\\u0420\\u043e\\u0441\\u0441\\u0438\\u044f'\n<\/pre>\n
- http:\/\/stackoverflow.com\/questions\/10569438\/how-to-print-unicode-character-in-python [↩<\/a>]<\/span><\/li><\/ol>","protected":false},"excerpt":{"rendered":"
Fixing unicode errors in python<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[9],"tags":[447],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t