Software Engineer (Backend and Distributed Systems) at Straive Technologies (2024-04 – Present)
Built and optimized high-scale distributed processing infrastructure for document processing workflows.
- Architected FastAPI backend orchestrating distributed Celery workers, Redis task queues, and PostgreSQL data persistence. Designed for 800 plus concurrent workflows.
- Implemented fault-tolerant distributed system: idempotent consumers, comprehensive retry mechanisms, safe fallback procedures, complete error handling.
- Built WebSocket-based real-time monitoring enabling live tracking of distributed operations and system health.
- Diagnosed production latency issue: identified inefficient request patterns (40 to 60 parallel tasks per workflow instead of optimized batching).
- Root cause analysis: frontend was creating excessive parallelism without considering throughput constraints and resource limits.
- Redesigned async orchestration: implemented intelligent batching, request deduplication, priority queuing. Added parallel Celery workers (8 to 10 concurrent).
- Performance improvement: 65 percent latency reduction (5 to 6 minutes to under 2 minutes), 60 percent throughput increase (500 to 800 plus jobs per day), zero infrastructure cost increase.
- Optimized PostgreSQL for high-concurrency scenarios: connection pooling, query optimization, indexing strategies. Reduced database load by 40 percent.
- Implemented Redis layer: caching for frequently accessed data, pub/sub for event broadcasting, distributed locks for atomicity across workers.
- Designed schemas and access patterns for horizontal scalability and concurrent read/write workloads.
- Architected fault-tolerant system with idempotent consumers, comprehensive retry mechanisms, safe fallback procedures.
- Implemented complete error handling, monitoring, and observability. Production system achieves 99 percent uptime under operational load.
- Built validation layers ensuring data integrity: transaction atomicity, safe degradation when components fail, state consistency guarantees.
Software Engineer Intern at Straive Technologies (2024-02 – 2024-04)
Developed core backend components of automation platform and implemented CI/CD infrastructure.
- Developed core backend components of automation platform. Built foundational distributed services for production SaaS.
- Implemented CI/CD pipelines (Git, Docker, GitHub Actions) reducing deployment time from hours to minutes.
