Job Description
Are you passionate about building high-performance data systems at scale? Shopee is seeking a highly skilled Backend Engineer to join our Data Infrastructure (OLAP) team. In this pivotal role, you will be responsible for the maintenance, optimization, and advancement of our Milvus-based vector database engine.
As part of a world-class engineering organization, you will work on complex distributed systems that power our core AI and search functionalities. You will deep-dive into the internals of vector database technologies, optimizing query latency, throughput, and system reliability to support massive traffic. If you thrive on solving deep technical challenges and contributing to open-source style infrastructure, we want to hear from you.
Responsibilities
- Design, develop, and maintain high-performance core components of the Milvus vector database engine.
- Optimize system performance, including query execution, indexing algorithms, and storage efficiency.
- Collaborate with cross-functional teams to integrate vector search capabilities into Shopee's product ecosystem.
- Troubleshoot and resolve complex production issues related to data consistency, system stability, and resource utilization.
- Conduct code reviews and contribute to architectural designs to ensure system scalability and maintainability.
- Implement automated testing and monitoring solutions to ensure the robustness of the data infrastructure.
- Stay up-to-date with the latest advancements in AI/ML infrastructure and vector database research.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
- Strong proficiency in C++ or Go, with a deep understanding of memory management and concurrency.
- Proven experience working with distributed systems, large-scale data storage, or OLAP engines.
- In-depth knowledge of database internals, indexing structures, and search algorithms.
- Experience with performance profiling, benchmarking, and kernel/system-level optimization.
- Familiarity with cloud-native technologies (e.g., Kubernetes, Docker) and cloud infrastructure.
- Excellent analytical, problem-solving, and communication skills in a collaborative environment.