Back to Playground
2023 AI HEALTH TECH

FOODBUDDY

The AI accountability partner you can eat with. Snap-to-track with zero friction.

AI Vision Health Tech GCP Social
Use arrow keys or buttons below to navigate
PART I: THE PROBLEM 02 / 09

The Accountability Gap

Tracking calories is boring; failing your diet is lonely. For calorie and macronutrient conscious mobile-first users, classical apps are mundane and unrewarding.

The "Data Entry" Churn

Classical apps treat food as spreadsheet data. This boring, mundane task causes users to stop recording meals within 2 weeks.

No Social Cost

Eating a donut in secret feels free. Eating it when you have to notify a buddy creates positive friction.

PART II: THE SOLUTION 03 / 09

Accountability as a Service

Elevator Pitch:
A social-first food tracker that uses AI Vision to lower friction and "Peer Pressure" to increase adherence.

Approach Pros Cons Verdict
Voice Logging Fastest input. Volume/Portion estimation is wildly inaccurate. Rejected
Barcode Scan Perfect accuracy. Useless for home-cooked meals. Backup feature
AI Vision + Social Zero friction + Social Motivation. Latency constraints. Selected
Social "Push"
  • One-to-many sharing.
  • Real-time notifications only on "Bad" choices.
  • "Better Judgement" recommendations.
PART III: TECHNOLOGY 04 / 09

Vision Pipeline

Leveraging early access to GPT-4 Vision and Gemini Pro Vision.

  • Input: Raw image buffer from camera.
  • Processing: Cloud Function spins up on valid upload.
  • Output: Structured JSON with macros and confidence score.
const analyzeFood = async (imageBuffer) => {
  const prompt = "Identify food items, estimate mass, and calculate macros.";
  
  const result = await model.generateContent([
    prompt, 
    { inlineData: { data: imageBuffer, mimeType: 'image/jpeg' } }
  ]);
  
  return parseJSON(result.response.text());
}
PART III: TECHNOLOGY 05 / 09

Frugal Architecture

Hosted on a GCP e2-micro instance to keep costs near zero while maintaining scalability.

Component Technology Why?
Backend Node.js / Express Lightweight, huge ecosystem.
Database Firestore Flexible schema for varying food data structures.
AI Model Gemini Pro Vision Lower latency & cost tailored for multimodal.
PART IV: RETROSPECTIVE 06 / 09

Why It Was Archived

The Unit Economics Problem
"While the 'snap-to-track' feature was magical, the cost of processing 3-5 high-res images per daily active user (DAU) made the specific free-tier model unsustainable in 2023."

However, the lessons learned in Context Engineering directly influenced later projects like FileOps.

PART V: VISUALS 07 / 09

Interface Preview

🥑

(Demo video archived)

APPENDIX 08 / 09

Technical Stack

Frontend

React Native

For cross-platform mobile reach.

Backend

GCP

Cloud Run & Cloud Functions.

AI

LangChain

Orchestration of vision & chat agents.

STATUS: UNMAINTAINED

The code lives on in private repos, but the spirit of AI-assisted accountability continues.

Back to Playground
© 2023-2025 Ashar Rai Mujeeb

Detailed Project Archive

Full writeup below

BACK TO PLAYGROUND

Foodbuddy

STATUS: ARCHIVED PLATFORM: MOBILE APP YEAR: 2023
AI Vision Health Tech GCP Social
🥑

The Accountability Partner You Can Eat With

Foodbuddy aimed to solve the hardest part of dieting: consistency. Most trackers require tedious manual entry. Foodbuddy used early multimodal AI models to simply allow users to "snap and track". But beyond tracking, it was about accountability.

"People don't need another calculator. They need a friend who gently judges their late-night pizza."

Core Features

Backend Architecture

We hosted the core services on a GCP e2-micro instance to keep costs near zero. The challenge was managing the heavy lifting of image processing.

// Handling the image upload and analysis queue
const processImageQueue = async (imageUrl, userId) => {
    // Determine complexity
    const analysis = await aiService.analyzeFood(imageUrl);
    
    // Store nutritional data
    await db.saveLog({
        userId,
        calories: analysis.calories,
        macros: analysis.macros,
        image: imageUrl
    });
    
    // Trigger the accountability agent
    await coachAgent.reactToMeal(userId, analysis);
}

Why It's Unmaintained

While the prototype was functional and the "snap-to-track" feature was magical, the unit economics of processing every meal image with high-end LLMs were difficult for a free side project. Additionally, the latency in 2023 for vision models was a friction point.

However, the lessons learned here directly influenced the "Context Engineering" work in later projects like FileOps.