β¨ Introduction
Meetings are an essential part of any organization, but keeping track of key discussions, decisions, and action items can be overwhelming. Recap AI solves this by recording, transcribing, and summarizing meetings, helping teams stay organized effortlessly.
In this post, I'll break down how I built Recap AI, the tech stack I used, the challenges I faced, and the key lessons I learned along the way.
π οΈ Tech Stack
To build Recap AI, I focused on scalability, accuracy, and a seamless user experience. Hereβs what I used:
Frontend (Mobile App & Web Dashboard)
- React Native β Cross-platform mobile app for recording meetings.
- Next.js β Web dashboard for managing recordings and summaries.
- TailwindCSS & Shadcn UI β For a clean and modern UI.
Backend & Infrastructure
- Node.js & Next.js API Routes β Backend logic for handling requests.
- PostgreSQL + Prisma β Storing meeting metadata and transcripts.
- Deepgram API β High-accuracy speech-to-text transcription.
- OpenAI API β Summarization and key point extraction.
Storage & Deployment
- Supabase β Storing transcripts and metadata.
- Vercel β Hosting the Next.js dashboard.
- Expo β Deploying the React Native app.
β‘ Challenges & How I Solved Them
1οΈβ£ Capturing Clear Audio for Transcription
Challenge: Mobile microphones often pick up background noise, reducing transcription accuracy.
Solution: I prompt users to use speaker mode while recording for better audio quality.
2οΈβ£ Handling Long Transcripts Efficiently
Challenge: Large transcripts slowed down summarization and storage.
Solution: I chunked transcripts into smaller sections before sending them to OpenAI, improving performance and accuracy.
3οΈβ£ Keeping Costs Manageable
Challenge: Transcription and AI summarization are expensive.
Solution:
- Used whisper-based transcription for lower-cost processing.
- Implemented rate limiting to prevent excessive API usage.
- Built a subscription model ($10/month) to sustain operations.
4οΈβ£ Designing a Simple Yet Powerful UX
Challenge: Users needed an intuitive way to access their recordings, transcripts, and summaries.
Solution:
- Implemented a bottom sheet UI for viewing transcripts and summaries.
- Added a Spotify-style audio player to listen to recordings.
π― Key Takeaways
1οΈβ£ Start simple, iterate fast β The first MVP only had basic recording and transcription. Over time, I added summarization and AI enhancements.
2οΈβ£ Optimize for cost early β AI-based features can get expensive quickly. Finding cost-effective alternatives was crucial.
3οΈβ£ User experience is everything β Even the best AI tech wonβt work if the UI is confusing. A clean, simple UX made Recap AI more usable.
4οΈβ£ AI is powerful, but not perfect β Transcription errors still happen, so adding manual editing features in the future could improve user control.
π Whatβs Next?
Recap AI is still evolving! Future updates may include:
β
Speaker identification β Highlighting who said what.
β
Meeting action items & follow-ups β AI-generated tasks based on discussions.
β
Desktop app version β To capture audio directly from system sound.
Try Recap AI π recap.itsaman.site
Have questions or feedback? Let me know in the comments! π