PySpark End-to-End ebook
A 113-page guide in Bahasa Indonesia that takes learners from first concepts to production patterns.
- DataFrames, transformations and joins
- Performance tuning and partitioning
- Common pitfalls, with fixes
Yam Studio turns hands-on experience with PySpark, dbt and GCP into structured lessons, ebooks and courses for learners in Indonesian and English.
Bootstrapped, founded in 2026, based in Jakarta, Indonesia.
# Slow: pulls every row onto the driver rows = df.collect() total = sum(r["amount"] for r in rows) # Fast: let the cluster aggregate total = df.agg(F.sum("amount")).first()[0]
Every lesson starts from a real mistake seen in client work, then explains why it happens and what to do instead.
Material is scattered across docs, blog posts and videos. Most of it explains syntax, not the decisions engineers make on real projects. Structured material in Indonesian is especially rare, so beginners stall between tutorials and the job.
We start from what actually happens in production work and teach it in order: concepts, patterns, common mistakes and how to fix them. An AI pipeline helps us produce and update material quickly, and every piece is reviewed by a working data engineer before it is published.
One paid product in market, three channels publishing every day, and two products in development.
A 113-page guide in Bahasa Indonesia that takes learners from first concepts to production patterns.
Produced end to end by our agent pipeline and published on a schedule.
Structured courses on dbt and GCP built from our full note library, plus a Q&A assistant that answers learners' questions using our own material.
A self-hosted, multi-agent system runs our whole publishing operation. More than ten specialised agents run on scheduled jobs, and every run reports to a Telegram workspace where we review, adjust or cancel before anything goes out.
Agents collect sources: our own data engineering notes, official release notes and changelogs, and community discussions.
A writing agent drafts posts, scripts and chapters. A second agent scores each draft and sends weak ones back for a rewrite.
Images, voice-over, subtitles and short videos are generated and rendered automatically.
Content is scheduled to Threads and YouTube. An analytics agent reads post insights and picks the next day's topics.
Built on Claude. Claude, served through Amazon Bedrock, handles the writing, reviewing and analysis stages. The agents run in Docker on our own hardware, and our public site, legal pages, media delivery and email run on Cloudflare (Pages, Tunnel and Email Routing).
Started building the agent pipeline and the first learning materials.
The 113-page PySpark ebook, sold on Lynk.id with a free sample.
Two accounts at 3 posts a day each. An analytics agent reads post insights and chooses the next day's topics.
Research, scripting, review, voice-over, rendering and scheduled upload, 2 videos a day, with no manual editing.
dbt and GCP courses generated from the full note library and reviewed chapter by chapter.
An assistant that answers questions grounded in our own lessons.
Yam Studio was founded by Yosie Abdul Muzanil, a data engineer who works hands-on with Spark on client projects. The studio started as a way to organise years of working notes, and became a way to share them with people learning the field.
The goal is simple: make practical data engineering easier to learn, and use AI for the repetitive work so the teaching stays focused and accurate.
We also offer a Spark performance audit for teams whose Spark jobs are slow or expensive. It draws on the same hands-on experience behind our learning material.