UnicodeDecodeError: ‘charmap’ codec can’t decode byte 0x98 in position 2251: character maps to <undefined> · Issue #7266 · pypa/pip · GitHub

Environment

• pip version: 19.3.1
• Python version: 3.8.0 x64
• OS: Windows 10 x64 10.0.17134 (system language Russian, cp1251)

Description
On same environment as from 2021 I still have this error on newer version python and pip when I try to install certain libraries on newer version (previous issue posted in comment of #4110 (comment) and i was manually fixed it by editing code (two posts below)). Now however all things changed and I don’t see solution for it, however take a look at output number 2.

Expected behavior
Install without error

How to Reproduce
Trying to install hiredis or libs it dependent on.

1. Run in cmd: pip install hiredis
2. An error occurs when it try to install it (check output number 1).

Output

1. When I use pypi

pip install hiredis
Collecting hiredis
  Using cached https://files.pythonhosted.org/packages/9e/e0/c160dbdff032ffe68e4b3c576cba3db22d8ceffc9513ae63368296d1bcc8/hiredis-1.0.0.tar.gz
    ERROR: Command errored out with exit status 1:
     command: 'c:pythonpython38python.exe' -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'G:\AppData\Local\Temp\pip-install-7t5ulr6t\hiredis\setup.py'"'"'; __file__='"'"'G:\AppData\Local\Temp\pip-install-7t5ulr6t\hiredis\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'rn'"'"', '"'"'n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'G:AppDataLocalTemppip-install-7t5ulr6thiredispip-egg-info'
         cwd: G:AppDataLocalTemppip-install-7t5ulr6thiredis
    Complete output (7 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "G:AppDataLocalTemppip-install-7t5ulr6thiredissetup.py", line 22, in <module>
        long_description=open('README.md', 'r').read(),
      File "c:pythonpython38libencodingscp1251.py", line 23, in decode
        return codecs.charmap_decode(input,self.errors,decoding_table)[0]
    UnicodeDecodeError: 'charmap' codec can't decode byte 0x98 in position 2251: character maps to <undefined>
    ----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

However after some tests I tried to do that:
2. Install from github repository

pip install git https://github.com/redis/hiredis-py
Collecting git https://github.com/redis/hiredis-py
  Cloning https://github.com/redis/hiredis-py to g:appdatalocaltemppip-req-build-m7i4cung
  Running command git clone -q https://github.com/redis/hiredis-py 'G:AppDataLocalTemppip-req-build-m7i4cung'
  Running command git submodule update --init --recursive -q
Installing collected packages: hiredis
    Running setup.py install for hiredis ... done
Successfully installed hiredis-1.0.0

Note: I don’t know why it still erroring on pypi package, but it may look, what old error return again? During this installation it looks like I can’t edit pip-install-7t5ulr6thiredissetup.py", line 22 to at least trying to fix it if it would happen to any other lib.