About Me

I'm Prashant Dudami, an AI/ML Architect with over 15 years of experience building enterprise-scale systems. My work focuses on making AI practical, cost-effective, and reliable for real-world business applications.

My Journey

My career has been a progression from data architecture to AI systems. At CSG International, I developed a patented methodology for data lake management that would later prove foundational for AI applications. This work earned a U.S. patent and has since been cited by R&D teams at Intuit, Johnson & Johnson, and Mastercard.

At Amazon Web Services, I worked as a Cloud Application Architect, leading technical discussions with enterprise clients and shaping AWS product strategy. This experience gave me deep insight into how organizations adopt AI technologies and the barriers they face.

Today, I focus on production Generative AI systems, particularly RAG (Retrieval-Augmented Generation) implementations that combine the power of LLMs with structured enterprise data. I've developed methodologies like TOON (Token Optimized Object Notation) that help organizations reduce their AI operational costs by 40-60%.

I believe in sharing knowledge openly. My open-source contributions and technical publications aim to help the broader technology community build better AI systems.

Professional Experience

Dec 2024 - Present

Lead Staff Software Engineer

Duetto Research

Design authority for production Generative AI systems. Implementing RAG systems integrating structured hospitality data with LLM-powered insights. Architecting hallucination-resistant chatbots leveraging real-time page context.

Production RAG system serving 300+ hotel properties99.5% uptime with sub-500ms average response latency95% factual accuracy in AI-generated insights
May 2024 - Oct 2024

Solutions Architect

Hitachi Solutions

Collaborated with enterprise clients to define requirements and translate them into scalable application architectures. Researched and implemented AI services on Microsoft Azure.

Azure AI integration patternsEnterprise data source integrationCross-platform cloud architecture
May 2022 - May 2024

Cloud Application Architect

Amazon Web Services

Technical leader working alongside customer business and infrastructure teams. Led design discussions with IT executives and influenced AWS product strategy by representing the voice for developers internally.

AWS Bedrock and Langchain expertiseShaped AWS Professional Services offeringsEnterprise AI adoption advisory
Nov 2020 - Mar 2022

Enterprise Solutions Architect

MakeGoodFood

Redesigned eCommerce platform architecture using micro-service patterns. Developed automated data pipelines for AI-driven reporting and automation use cases.

Platform architecture redesignAI-ready data pipelinesTeam leadership and mentorship
Dec 2016 - Nov 2020

Technical Lead

CSG International

Led design and development of Ascendon, a large-scale cloud-based SaaS platform. Built scalable microservices for a DataLake architecture on AWS. Granted U.S. Patent for data lake methodology.

U.S. Patent No. 10,846,307 B1Cloud-native SaaS platformEnterprise data lake architecture

Technical Expertise

AI/ML Infrastructure
Large Language Models (LLMs)Retrieval-Augmented Generation (RAG)AWS BedrockLangChain FrameworkPrompt EngineeringToken Optimization
Cloud Platforms
Amazon Web Services (AWS)Microsoft AzureGoogle Cloud PlatformServerless ArchitectureKubernetes/EKSInfrastructure as Code
Data Architecture
Data Lake DesignETL PipelinesReal-time Data ProcessingData ModelingAnalytics SystemsDatabase Optimization
Software Engineering
MicroservicesAPI DesignPython.NET/C#TypeScriptSystem Design

Key Achievements

U.S. Patent Holder

Granted U.S. Patent No. 10,846,307 B1 for 'System and Method for Managing Interactions with Data Lake' - cited by Fortune 500 companies including Intuit, Johnson & Johnson, and Mastercard.

Open Source Contributor

Creator of TOON Converter (Token Optimized Object Notation) - a Python library that reduces LLM token consumption by 40-60%, published on PyPI and GitHub.

Technical Author

Published technical articles on enterprise AI, LLM optimization, and data architecture reaching thousands of practitioners in the AI/ML community.

Let's Work Together

Whether you need help with LLM infrastructure, RAG implementation, or AI cost optimization, I'm here to help.