This actually works a lot. Telegram downloads are glitchy and if they detect a slow network, they will just pause until the network is fast again. As soon as I upgraded my internet speed, the download was significantly faster. I think it was even as fast as IDM on my PC. Another solution is to turn off auto downloads on your Telegram app. It has something to do with queueing media downloads and it will improve your speed on small files.