Reduce dependencies by removing unused ones

[digikar99]

If you can wait before merging, I will also try to look into other systems. But it might take some time.

Reducing dependencies for plot/vega would be slightly non-trivial

[github-actions]

Thank you for your submission, we really appreciate it. Like many open-source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution. You can sign the CLA by just posting a Pull Request Comment same as the below format.

---

I have read the CLA Document and I hereby sign the CLA

---

_{You can retrigger this bot by commenting recheck in this Pull Request. Posted by the CLA Assistant Lite bot.}