AI Forward Deployed Engineer
IBM · New York City, NY
May 2025 – Present
- Client-facing post-deployment work: partner directly with enterprise customers to develop custom solutions on top of the deployed platform, then migrate those solutions onto client systems for a clean handoff into their environment.
- Architected and deployed 3 scalable AI microservices on IBM Granite 3.3 and Llama 3.3, implementing RAG patterns that process 1M+ queries at 87% answer relevance for enterprise IT and HR support agents.
- Optimized LLM inference with Redis-based prompt caching and request batching — 40% less API overhead while holding <1.5s P95 latency.
- Built automated evaluation pipelines benchmarking accuracy, latency, and cost-per-token across model variants, cutting model selection cycle time 35% and directly informing deployment decisions for Fortune 500 clients.
RAGIBM Granite 3.3Llama 3.3
RedisPythonDockerAWS