Writer is an AI writing assistant used by brands
like Twitter, Intuit, and Accenture. The NLP team uses a
microservice architecture based on Kubernetes, FastAPI, HuggingFace
Transformers, NVIDIA Triton, and ONNX.
- Responsible for NLP from research to
operations, including >25 microservices
- Trained an encoder/decoder Grammar Error
Correction model using novel synthetic data techniques, which
outperformed an open-source baseline by 130%
- Used NVIDIA Triton and ONNX to serve a
character-based transformer spelling correction model while
keeping inference latencies below 300ms at 50 req/s