TensorFlow Serving performance optimization @TensorFlow
TensorFlow Serving performance optimization  @TensorFlow
Uploaded August 2022 | Updated November 2026, 3 hours ago
Wei Wei, Developer Advocate at Google, shares general principles and best practices to improve TensorFlow Serving performance. He discusses how to improve the latency for API surfaces, batching, and more parameters that you can tune.

Resources:
TensorFlow Serving performance guide → https://goo.gle/3zW168E
Profile Inference Requests with TensorBoard → https://goo.gle/3zWjluJ
TensorFlow Serving batching configuration → https://goo.gle/3xT2SVz
TensorFlow Serving SavedModel Warmup → https://goo.gle/3ygfIhT
XLA homepage → https://goo.gle/3zY01gw
How to make TensorFlow models run faster on GPUs (with XLA) → https://goo.gle/3OAB8LR
How OpenX Trains and Serves for a Million Queries per Second in under 15
Milliseconds → https://goo.gle/3NdAOSd
ResNet complete example → https://goo.gle/3zU1PHs

Deploying Production ML Models with TensorFlow Serving playlist → https://goo.gle/tf-serving Subscribe to TensorFlow → https://goo.gle/TensorFlow

#TensorFlow #MachineLearning #ML
TensorFlow Serving performance optimizationRecommendation with TF Agents Bandits Library (Reinforcement learning with TensorFlow Agents)Creating successful study groups to empower everyoneChip floorplanning with deep reinforcement learningTake action and start building with Google AIBuilding Machine Learning models with Edge ImpulseYoha: Write in thin air with custom hand tracking  - Made with TensorFlow.jsAccessible data science with Hal9 - Made with TensorFlow.jsDeploying ML models to mobile devicesTop 5 takeaways from Women in Machine Learning Symposium 2023Introducing Coral Dev Board MicroRevolutionizing sign language with AI
TensorFlow |

TensorFlow Serving performance optimization

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER