OneCup AI customer reference

OneCup AI Builds Livestock Face Recognition and Monitoring Platform with NVIDIA

2021

OneCup AI provides Bovine Expert Tracking and Surveillance (BETSY), an artificial intelligence (AI)-powered, facial recognition, tracking, and surveillance platform for the ranching industry. By layering Amazon Web Services (AWS) on top of NVIDIA’s solutions procured from AWS Marketplace, OneCup AI was able to build, scale, and run hundreds of experiments. This enabled the company to create AIs that fluidly process video footage of livestock.

managed services cloud strategies
kr_quotemark

There was no way to scale our technology up and test it without accessing DeepStream’s prebuilt systems in AWS Marketplace and combining it with models for training. It simply was not viable. With these solutions, we can now scale worldwide quite easily.”

Geoffrey Shmigelsky
CTO and Co-founder, OneCup AI

The Data Obstacles of Livestock Recognition AI

OneCup AI helps ranchers stay on top of animal welfare and improve their return on investment per animal. The company’s BETSY solution is an AI-powered recognition and surveillance platform. To build BETSY, the company developed over 25 separate AIs with independent architectures and linked them together into a giant pipeline. These AIs enable BETSY to monitor the health, activity, nutrition, and growth of cattle and other livestock 24x7. Each animal’s unique appearance is examined to generate an identity, forming the basis of a permanent visual identification system. This identity can then be used to detect lameness and sickness, as well as to track individual and group activity. BETSY provides eyes on the ground and can be where the rancher cannot, monitoring with precision both day and night.
 
Building BETSY to be an effective recognition program for animals presented significant challenges for OneCup AI. Expanding production and rapidly building and training its models were essential. Geoffrey Shmigelsky, chief technology officer and co-founder of OneCup AI explains, “We had to run hundreds of experiments to find the right combinations of models, datasets, and training techniques. The company had to significantly increase testing and do so quickly.”

In addition, BETSY had to be able to process the estimated billion data points produced each month by individual ranches situated in rural environments. “Internet performance in rural parts of the world is very poor,” Shmigelsky notes. “In our core market of Canada, the average upload speed is only two megabits per second (Mbps) while the average download speed is 10 Mbps. To move data into the cloud for processing, two Mbps is not going to cut it. A single BETSY camera runs at four Mbps, meaning four cameras will saturate a ranch’s maximum speed of 15 to 20 Mbps.”

Analyzing Data to Build AI Models

Needing to scale production and save time, the company chose to procure software from AWS Marketplace. OneCup AI discovered NVIDIA’s DeepStream software development kit (SDK), which delivers a complete streaming analytics toolkit for AI-based multi-sensor processing, video, and image understanding. DeepStream’s plugins bring deep neural networks and other complex processing tasks into a stream processing pipeline. The company coupled this with pretrained models from NVIDIA’s NGC catalog of software for AI, high performance computing, and visualization. For the non-NGC models used to build OneCup AI’s face identification system, the company used Amazon SageMaker Edge Manager to build notebooks for testing.

According to Shmigelsky, “We took DeepStream and extensively modified it to do what BETSY’s 25 separate but linked AIs needed, extending the standard two layers to five. As each AI layer does something different, we had to train, build, and customize each with specialized datasets, architectures, and medical parameters. We also don't just build one AI that goes everywhere; we build a custom identification model for each ranch. There was no way to scale our technology up and test it without accessing DeepStream’s prebuilt systems in AWS Marketplace and combining it with models for training. It simply was not viable. With these solutions, we can now scale worldwide quite easily."

Solving Data Processing Challenges

The rural locations of typical ranches meant that OneCup AI had to tackle the data limitations inherent to these types of environments. Shmigelsky explains, “Our company has built AI that can not only visually identify an animal but can also tell you what the animal is doing. It can do this both on an instance basis and on a temporal basis over a series of frames of video. Consequently, BETSY generates a significant amount of data. The slow internet speed at most ranches meant that moving data to the cloud for processing was not a viable option.”
 
With this limitation in mind OneCup AI focused on adopting edge computing. Continuing to work with NVIDIA, the company decided on the Jetson AGX Xavier workstation, specifically designed for autonomous machines and AI inferencing capabilities on edge devices. The company combined this computer with AWS IoT Greengrass, an open-source edge runtime and cloud service for building, deploying, and managing device software. Shmigelsky points out, “Jetson AGX Xavier plays quite nicely with Greengrass. This service allows us to manage the device, deploy components, and create and deploy custom base identification (ID) models for each ranch that we work with.”

To tackle the data itself, OneCup AI looked to two additional AWS solutions. As a language for application programming interfaces (APIs), GraphQL enabled the company to query and manipulate data easily through an intuitive and flexible syntax while the fast, scalable, and serverless Amazon Timestream series database service for internet of things (IoT) processed all the data. Shmigelsky notes, “That's how we’re able to handle billions of records.”

Layering Solutions to Develop Effective AI

AWS services and NVIDIA solutions procured fromo AWS Marketplace enabled OneCup AI to gain the scalability and speed needed to surmount the data challenges of livestock recognition. Shmigelsky explains, “Layering AWS services on top of NVIDIA’s solutions enabled our company to build, scale, and run hundreds of experiments. We ran these experiments on different model architectures, as well as training sizes and meta parameters. All to create AIs that are simply fluid when it comes to processing video footage of animals.”

Looking Ahead

OneCup AI is following the continued progress of satellite internet with optimism. With SpaceX Starlink satellite internet coming online late in 2021, the company sees a clear opportunity for significant growth. With the connectivity supplied by Starlink, OneCup AI hopes to gain access to the remainder of the estimated 22.5 billion global population of livestock, as well as other animals.

“Starlink will enable us to run BETSY at full power at millions of ranches around the world, using the AWS Cloud,” Shmigelsky points out. “Consequently, we will be able to process and consume information on a scale that was previously unimaginable in the agricultural technology industry.” With internet data limitations lifted, OneCup AI expects to expand its use of AWS services to continue to develop and extend its solution offerings.


About OneCup AI

OneCup AI provides Bovine Expert Tracking and Surveillance (BETSY), an AI-powered, facial recognition, tracking, and surveillance platform for the ranching industry. By layering AWS services on top of NVIDIA’s solutions, OneCup AI was able to build, scale, and run hundreds of experiments. This allowed the company to create AIs that are simply fluid when it comes to processing video footage of animals.

About the seller - NVIDIA

NVIDIA provides GPU-optimized software for deep learning (DL), machine learning (ML), and high-performance computing (HPC) that accelerates deployment to development workflows so data scientists, developers, and researchers can focus on building solutions, gathering insights, and delivering business value.

Benefits of AWS Marketplace

  • Rapidly built and trained AI models
  • Surmounted data challenges with scalability, speed, and edge computing
  • Processed billions of data records

AWS Services Used

AWS Marketplace

AWS Marketplace is a digital catalog with thousands of software listings from independent software vendors that make it easy to find, test, buy, and deploy software that runs on AWS.

Learn more »

AWS IoT Greengrass

AWS IoT Greengrass is an open-source edge runtime and cloud service for building, deploying, and managing device software.

Learn more »

Amazon SageMaker Edge

Amazon SageMaker Edge enables machine learning on edge devices by optimizing, securing, and deploying models to the edge, and then monitoring these models on your fleet of devices, such as smart cameras, robots, and other smart-electronics, to reduce ongoing operational costs.

Learn more »

Amazon Timestream

Amazon Timestream is a fast, scalable, and serverless time series database service for IoT and operational applications that makes it easy to store and analyze trillions of events per day up to 1,000 times faster and at as little as 1/10th the cost of relational databases.

Learn more »


Get Started

Companies of all sizes across all industries are transforming their businesses every day using AWS. Contact our experts and start your own AWS Cloud journey today.