Skip to content

About

Fine-tuning LLM — LoRA / QLoRA patterns, prompt engineering, versioning, evaluation with RAGAS

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

1 Commit

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Senior AI Engineer — Interview Preparation

Who This Is For

You are a Senior Full Stack Developer (Java, Angular, DevOps, CI/CD, Cloud) transitioning into a Senior AI Engineer role. You are NOT targeting AI Architect or Team Lead. You are targeting Senior AI Engineer at product companies and MNCs.


Folder Architecture

senior-ai-engineer/
│
├── 01-ai-engineering-fundamentals/   — AI + LLM Fundamentals (Senior Depth)
│   ├── ai-vs-ml-vs-llm-production-framing.md
│   ├── evaluation-metrics-production-kpis.md
│   ├── bias-variance-overfitting-senior.md
│   ├── hallucination-root-cause-detection-mitigation.md
│   └── token-economics-cost-latency-throughput.md
│
├── 02-llm-core/   — LLM Core (Production-Grade)
│   ├── prompt-engineering-at-scale.md
│   ├── context-window-engineering-around-limits.md
│   ├── embeddings-model-drift-refresh.md
│   ├── vector-databases-faiss-pinecone-pgvector.md
│   └── llm-security-injection-jailbreaks-leakage.md
│
├── 03-rag-systems/   — RAG Systems (Production-Grade)
│   ├── rag-pipeline-architecture-failure-modes.md         ← BRO: CRAG quality gate, FAISS+BM25 hybrid
│   ├── chunking-strategies-tradeoffs.md                   ← BRO: 512-token recursive chunks on CV text
│   ├── retrieval-optimization-hybrid-reranking-mmr.md     ← BRO: real cross-encoder reranker implemented
│   ├── rag-evaluation-ragas-precision-recall.md           ← BRO: RAGAS + LLM-as-judge per role mapping
│   └── advanced-rag-self-rag-crag-hyde.md                 ← BRO: HyDE + CRAG + RRF fusion pipeline
│
├── 04-agentic-ai-systems/   — Agentic AI Systems (Senior Depth)
│   ├── agent-vs-workflow-decision-framework.md            ← BRO: 4-agent pipeline (parser→mapper→planner→tracker)
│   ├── multi-agent-orchestration-supervisor-peer-hierarchical.md  ← BRO: asyncio.gather for parallel day planning
│   ├── tool-usage-function-calling-reliability.md         ← BRO: CV search + role lookup tools with auth
│   ├── planning-vs-execution-react-plan-execute-tot.md    ← BRO: Plan-and-Execute for 30-day resource plan
│   ├── failure-handling-guardrails-fallback.md            ← BRO: G1–G5 production guardrails (all implemented)
│   └── agent-state-management-memory-persistence.md       ← AURA: multi-tenant episodic correction store (SQLite, tenant_id-partitioned) + per-tenant persona injection into LangGraph state
│
├── 05-ai-system-design/   — AI System Design (Senior Depth)
│   ├── chat-with-pdf-at-scale-production-design.md
│   ├── rag-at-scale-latency-budget-caching.md             ← BRO: L1/L2 semantic cache, DeepSeek TTFT
│   ├── streaming-responses-sse-websocket.md               ← BRO: SSE plan generation + Angular EventSource
│   ├── cost-optimization-llm-systems.md                   ← BRO: model tiering for gap analysis vs routing
│   ├── ai-api-gateway-rate-limiting-quota-fallback.md     ← BRO: JWT auth + rate limit + circuit breaker chain
│   └── api-gateway-rate-limiting-caching-routing.md
│
├── 06-mlops-for-llms/   — MLOps for LLMs (Senior Depth)
│   ├── model-serving-fastapi-bentoml-vllm.md              ← BRO: multi-stage Docker, non-root, K8s-ready
│   ├── monitoring-latency-drift-hallucination-cost.md     ← BRO: CI/CD pipeline, pytest + ng build on every PR
│   ├── feedback-loops-rlhf-lite-finetune-pipeline.md      ← AURA: multi-tenant human-in-the-loop correction logging → per-tenant episodic memory → Phase 3 per-tenant LoRA fine-tune roadmap
│   └── versioning-models-prompts-embeddings-data.md       ← BRO: Role CRUD + async FAISS/BM25 index rebuild
│
├── 07-real-time-ai-systems/   — Real-Time AI Systems (Senior Depth)
│   ├── event-driven-pipelines-kafka-llm-worker.md         ← BRO: Kafka topics bench.cv.uploaded + bench.dlq
│   ├── async-llm-workflows-queue-retry-dlq.md             ← BRO: async plan generation, 202 + poll pattern
│   └── streaming-inference-token-streaming-sse.md         ← BRO: DeepSeek token stream → Angular Signal
│
├── 08-frameworks-and-tools/   — Frameworks & Tools (Senior Depth)
│   ├── langchain-when-to-use-escape-hatches.md
│   ├── langgraph-state-machines-conditional-edges.md
│   ├── faiss-vs-pgvector-vs-pinecone-production.md
│   └── openai-api-retry-rate-limits-fallback.md
│
├── 09-projects-and-storytelling/   — Your Projects (Storytelling for Senior Role)
│   ├── how-to-tell-your-ai-project-story.md
│   ├── deep-dive-script-astrointel-langchain.md           ← AstroIntel + LangChain deep dive + Q&A
│   └── deep-dive-script-bench-resource-optimizer.md       ← BRO: 3-level script + 20 Q&A + architecture
│
├── 10-advanced-topics/   — Advanced Topics (Senior Awareness Layer)
│   ├── fine-tuning-vs-rag-decision-matrix.md
│   ├── lora-qlora-when-your-team-needs-it.md
│   ├── rlhf-how-it-shaped-gpt4.md
│   └── multi-modal-ai-vision-text-architecture.md
│
├── 11-interview-mastery/   — Interview Mastery (Senior AI Engineer Edition)
│   ├── senior-answer-framework-40-50-lpa.md
│   └── mind-map-senior-ai-engineer-full-system.md
│
├── 12-java-spring-bridge/   — Java/Spring Bridge (YOUR UNIQUE DIFFERENTIATOR)
│   ├── llm-apis-into-spring-boot-microservices.md
│   ├── cicd-for-ai-model-versioning-jenkins-github-actions.md
│   ├── cloud-deployment-aws-gcp-ecs-cloud-run-sagemaker.md
│   └── devops-for-ai-docker-fastapi-llm-workers-k8s.md
│
├── ai-engineer-architect-bible/   — 5 Universal AI Architecture Patterns (Production Code + Interview Cheat Sheets)
│   ├── 01-plain-llm-application.md     — Golden Memory: Request → Prompt → LLM → Parse → Response
│   ├── 02-rag-application.md           — Golden Memory: Document → Chunk → Embed → Store | Query → Embed → Retrieve → Context → LLM
│   ├── 03-agent-tool-calling.md        — Golden Memory: Think → Tool → Result → Think → Answer
│   ├── 04-memory-based-ai.md           — Golden Memory: Retrieve → Context Build → LLM → Store
│   └── 05-streaming-and-async.md       — Golden Memory: Generate → Push Token → Repeat | Accept → Queue → Worker → Status
│
└── python-for-ai-engineering/   — 5-Phase Python curriculum (Java-anchored) + Revision
    ├── phase-1-python-core-for-java-devs/         — 8 lessons: syntax, OOP, async, error handling
    ├── phase-2-python-production-internals/        — 8 lessons: decorators, context managers, dataclasses, typing
    ├── phase-3-python-ai-libraries/                — 8 lessons: NumPy, pandas, HuggingFace, OpenAI SDK, LangChain
    ├── phase-4-ai-engineering-projects/            — 8 lessons: RAG pipelines, vector DBs, FastAPI, agents, streaming
    ├── phase-5-senior-ai-architecture/             — 5 lessons: clean structure, DI, background jobs, caching, observability
    └── revision-1/PYTHON-AI-ENGINEER-REVISION.md  — All 5 phases condensed: concept + Java anchor + code + interview line

What Is Different from the Basic Notes

Basic Notes Senior AI Engineer Notes
Theory-first Production-first — what breaks, why, how you fixed it
Short Q&A answers (2-3 lines) Full senior answers (5-7 lines with trade-offs + real examples)
No background bridge Module 12 maps your Java/DevOps/Cloud skills to AI directly
Missing topics Added: Token Economics, LLM Security, Advanced RAG, Agent State, API Gateway, Feedback Loops
Generic examples Examples tied to your actual projects (AstroIntel, LangChain Service)

AstroIntel — What You Actually Built (Live Evidence for Interviews)

What Result Where in Notes
415-test enterprise suite (unit + live) 415/415 passing Module 4, Module 6, Module 9
Ground truth accuracy — 20 famous profiles 134/134, 5/5 dimensions = 100% Module 1, Module 3, Module 9
Multi-tenant SaaS auth: USER/ADMIN/SUPERADMIN roles 76/76 tests passing Module 5, Module 9, Module 12
JWT Bearer + X-API-Key dual auth with key revocation Verified live Module 5
Rate limiter keyed by tenant_id (not user-supplied input) Verified live Module 5
Dockerize + EC2 deploy Next phase (auth complete, deploy pending) Module 12

Auth system files built: auth/models.py, auth/store.py, auth/dependencies.py, auth/router.py, tests/test_auth.py


Bench Resource Optimizer — What You Actually Built (Live Evidence for Interviews)

What Result Where in Notes
222-test enterprise suite — full stack 222/222 passing, 3.6s runtime Module 1, Module 6
Hybrid RAG: FAISS + BM25 + RRF + HyDE + CRAG + cross-encoder rerank Live, verified Module 3
G1–G5 Production guardrails: rate limit, injection, hallucination, PII, token budget Live, all tested Module 4, Module 5
JWT HS256 auth — role-based (admin/user), startup secret validation Live, 24 auth tests Module 5
Semantic cache L1 (exact hash) + L2 (cosine ≥ 0.92) with Redis Live Module 5
Multi-tenant episodic memory: per-tenant corrections, retrieval, persona injection, custom persona pref Live, 30 tests (14 isolation) Module 4, Module 6
SSE streaming plan generation + Angular EventSource consumer Live Module 5, Module 7
Kafka event architecture: 3 topics + DLQ Implemented Module 7
Admin Role CRUD API + async FAISS/BM25 index rebuild on role change Live, 15 role tests Module 6
Readiness score time-series history — trend chart in dashboard Live Module 1

Project files: bench-resource-optimizer/ — see SYSTEM_ARCHITECTURE.md for full module coverage map


How to Use

  1. Read the corresponding senior file AFTER reading the basic file — they build on each other
  2. Module 12 is your competitive edge — no other candidate has this bridge
  3. In interviews, always anchor answers to your projects in Module 9
  4. Practice the Answer Framework in Module 11 before any interview
  5. ai-engineer-architect-bible/ — memorize all 5 golden memories cold. When an interviewer asks "write a RAG system", you draw the architecture first, then the production code pattern
  6. python-for-ai-engineering/ — use revision-1/PYTHON-AI-ENGINEER-REVISION.md as your 30-minute pre-interview refresher for all Python patterns

About

Fine-tuning LLM — LoRA / QLoRA patterns, prompt engineering, versioning, evaluation with RAGAS

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages