{"repo":"unum-cloud/UCall","free":true,"listed":false,"github":"https://github.com/unum-cloud/UCall","clone":"git clone https://github.com/unum-cloud/UCall.git","description":"Web Serving and Remote Procedure Calls at 50x lower latency and 70x higher bandwidth than FastAPI, implementing JSON-RPC & REST over io_uring ☎️","language":"C","stars":1331,"topics":["cpython","epoll","fast-api","flask","io-uring","json","json-rpc","liburing","python","http"],"license":"Apache-2.0","category":"api-integrations-sdks","readme_excerpt":"UCall JSON Remote Procedure Calls Library Up to 100x Faster than FastAPI                 --- Most modern networking is built either on slow and ambiguous REST APIs or unnecessarily complex gRPC. FastAPI, for example, looks very approachable. We aim to be equally or even simpler to use. FastAPI UCall It takes over a millisecond to handle a trivial FastAPI call on a recent 8-core CPU. In that time, light could have traveled 300 km through optics to the neighboring city or country, in my case. How does UCall compare to FastAPI and gRPC? Setup 🔁 Server Latency w 1 client Throughput w 32 clients :---------------------- :---: :----: -----------------: ----------------------: Fast API over REST ❌ 🐍 1'203 μs 3'184 rps Fast API over WebSocket ✅ 🐍 86 μs 11'356 rps ¹ gRPC ² ✅ 🐍 164 μs 9'849 rps UCall with POSIX ❌ C 62 μs 79'000 rps UCall with io uring ✅ 🐍 40 μs 210'000 rps UCall with io uring ✅ C 22 μs 231'000 rps Table legend All benchmarks were conducted on AWS on general purpose instances with Ubuntu 22.10 AMI . It is the first major AMI to come with Linux Kernel 5.19 , featuring much wider io uring support for networking operations. These specific numbers were obtained on c7g.metal beefy instances with Graviton 3 chips. - The 🔁 column marks, if the TCP/IP connection is being reused during subsequent requests. - The \"server\" column defines the programming language, in which the server was implemented. - The \"latency\" c","default_branch":null,"files":null,"tree":[],"storefront":"/r/unum-cloud","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/unum-cloud/UCall/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}