Show HN: Pip install inference, open source computer vision deployment Deploying vision models is time consuming and tedious. Setting up dependencies. Fixing conflicts. Configuring TRT acceleration. Flashing (and re-flashing) NVIDIA Jetsons. A streamlined, developer-friendly solution for inference is needed. We, the Roboflow team, have been hard at work open sourcing Inference, an open source vision deployment solution. Our solution is designed with developers in mind, offering a HTTP-based interface. Run models on your hardware without having to write architecture-specific inference code. Here's a demo showing how to go from a model to GPU inference on a video of a football game in ~10 minutes: https://www.youtube.com/watch?v=at-yuwIMiN4 Inference powers millions of daily API calls for global sports broadcasts, one of the world’s largest railways, a leading electric car manufacturer, and multiple other Fortune 500 companies, along with countless hackers’ hobby and research projects. Inference works in Docker and supports CPU (ARM and x86), NVIDIA GPU, and TRT. Inference manages dependencies and the environment. All you need to do is make HTTP requests to the server. YOLOv5, YOLOv8, YOLACT, CLIP, SAM, and other popular vision models are supported (some models need to be hosted on Roboflow first, see the docs; we're working on bring your own model weights!). Try it out and tell us what you think! https://ift.tt/en0Z6zw August 23, 2023 at 04:34PM
Show HN: Pip install inference, open source computer vision deployment https://ift.tt/d7ZLfA3
Related Articles
Show HN: Google Alerts for your favorite people https://ift.tt/3xaoJ8OShow HN: Google Alerts for your favorite people https://alias.co June … Read More
Show HN: AWS Step Functions New Workflow Studio https://ift.tt/3vxjdfbShow HN: AWS Step Functions New Workflow Studio https://ift.tt/2Ufj1o3… Read More
Show HN: App that blocks opening other apps until you write your purpose (Beta) https://ift.tt/3wJSwFmShow HN: App that blocks opening other apps until you write your purpo… Read More
Show HN: Customers are your best advertisers https://ift.tt/3iRFBxlShow HN: Customers are your best advertisers https://www.orbik.com/ Ju… Read More
Show HN: Learn a new language while you browse the web https://ift.tt/3gkrjlQShow HN: Learn a new language while you browse the web https://www.flu… Read More
Show HN: Super Follow for Superfans https://ift.tt/3ww3zlqShow HN: Super Follow for Superfans https://joinroro.com/ June 12, 202… Read More
Show HN: Raytracer with both C++ and CUDA back ends https://ift.tt/3vDfD3jShow HN: Raytracer with both C++ and CUDA back ends https://ift.tt/3q8… Read More
Show HN: Made an app called Seamless to replace AirDrop in some ways https://ift.tt/3iwXt0cShow HN: Made an app called Seamless to replace AirDrop in some ways h… Read More
0 Comments: