# Event Details

- **Event Name**: Foundations of Distributed Training: How Modern AI Systems Are Built
- **Event Start and End Date**: Fri, 20 Feb, 2026 at 12:30 pm
- **Event Description**: We are excited to welcome Suman Debnath, Technical Lead in Machine Learning at Anyscale, for a practical and intuitive introduction to distributed training.

Talk Description:
As modern AI models continue to grow, single-GPU training is no longer enough. Distributed training has become essential, but scaling models introduces challenges that require understanding communication patterns, system bottlenecks, and key trade-offs.
In this session, we will break down distributed training from first principles. We will explore why single-GPU training hits limits, how transformer models manage memory, and what techniques like gradient accumulation, checkpointing, and data parallelism actually do.
We will also demystify communication primitives, walk through ZeRO-1, ZeRO-2, ZeRO-3 and FSDP, and show how compute and communication can be overlapped for better efficiency. Finally, we will connect these concepts to real-world tooling used in frameworks like Ray and PyTorch. Attendees will gain a clear, grounded understanding of how distributed training works and when to apply different strategies.

Bio:
Suman Debnath is a Technical Lead in Machine Learning at Anyscale, where he works on large-scale distributed training, fine-tuning, and inference optimization in the cloud. His expertise spans Natural Language Processing, Large Language Models, and Retrieval-Augmented Generation.
He has also spoken at more than one hundred global conferences and events, including PyCon, PyData, and ODSC, and has previously built performance benchmarking tools for distributed storage systems.

We look forward to seeing you!

#DataScience #MachineLearning #DistributedTraining #Ray #PyTorch #LLM #RAG #DeepLearning #USFCA #USFMSDSAI #DataInstitute #AIEngineering #TechTalk
- **Event URL**: https://allevents.in/san-francisco/foundations-of-distributed-training-how-modern-ai-systems-are-built/200029693158526
- **Event Categories**: workshops
- **Interested Audience**: 
  - total_interested_count: 1

## Ticket Details

- **Ticket URL**: https://www.meetup.com/usf-data-science-and-ai-speaker-series/events/312502163/?eventOrigin=group_upcoming_events&utm_source=AllEvents.in&utm_medium=event-discovery-platform&utm_campaign=san+francisco-events

## Event venue details

- **city**: San Francisco
- **state**: CA
- **country**: United States
- **location**: 101 Howard St, San Francisco, CA 94105-1616, United States
- **lat**: 37.79088
- **long**: -122.39253
- **full address**: 101 Howard St, San Francisco, CA 94105-1616, United States

## Event Organizer details

- **affiliate_id**: 2
- **organizer**: USF Data Institute (https://allevents.in/org/usf-data-institute/13797255)

## Event gallery

- **Alt text**: banner
  - **Image URL**: https://cdn-az.allevents.in/events6/banners/080a8efb834ba7796da979872cd5c35df0ef7abd421098953d6be89fe05bea49-rimg-w800-h800-dcc4baa8-gmir?v=1771499726
- **Alt text**: thumbnail
  - **Image URL**: https://cdn-az.allevents.in/events6/banners/22a54d3ba8b2c739128063e1a93fdde62171fb43b9fb9da2398e506697341004-rimg-w300-h300-dcc4baa7-gmir?v=1771499726

## FAQs

- **Q**: When is the event happening?
  - **A:** Fri, 20 Feb, 2026 at 12:30 pm
- **Q**: Where is the event happening?
  - **A:** 101 Howard St, San Francisco, CA 94105-1616, United States
- **Q**: Who is organizing the event?
  - **A:** USF Data Institute
- **Q**: What type of event is this?
  - **A:** workshops
- **Q**: Where can I find ticket details about Foundations of Distributed Training: How Modern AI Systems Are Built ?
  - **A:** You can find ticket details about this event on AllEvents.

## Structured Data (JSON-LD)

```json
[
    {
        "@context": "https://schema.org",
        "@type": "Event",
        "name": "Foundations of Distributed Training: How Modern AI Systems Are Built",
        "image": "https://cdn-az.allevents.in/events6/banners/080a8efb834ba7796da979872cd5c35df0ef7abd421098953d6be89fe05bea49-rimg-w800-h800-dcc4baa8-gmir?v=1771499726",
        "startDate": "2026-02-20",
        "url": "https://allevents.in/san-francisco/foundations-of-distributed-training-how-modern-ai-systems-are-built/200029693158526",
        "location": {
            "@type": "Place",
            "name": "101 Howard St, San Francisco, CA 94105-1616, United States",
            "address": {
                "@type": "PostalAddress",
                "streetAddress": "101 Howard St, San Francisco, CA 94105-1616, United States",
                "addressLocality": "San Francisco",
                "addressRegion": "CA",
                "addressCountry": "US"
            },
            "geo": {
                "@type": "GeoCoordinates",
                "latitude": "37.79088",
                "longitude": "-122.39253"
            }
        },
        "eventAttendanceMode": "https://schema.org/OfflineEventAttendanceMode",
        "description": "We are excited to welcome Suman Debnath, Technical Lead in Machine Learning at Anyscale, for a practical and intuitive introduction to distributed training.\n\nTalk Description:\nAs modern AI models continue to grow, single-GPU training is no longer enough. Distributed training has become essential, bu",
        "organizer": [
            {
                "@type": "Organization",
                "name": "USF Data Institute",
                "url": "https://allevents.in/org/usf-data-institute/13797255",
                "description": "The Data Institute is creating a new partnership between industry and academia. "
            }
        ]
    }
]
```