Hugging Peers

code-embed

☆ Save
by divakantpandey feature-extraction sentence-transformers cc-by-nc-4.0
27 downloads 1 likes on Hugging Face updated

Model card

💻 code-embed

CodeEmbed is a lightweight, high-performance code embedding model (≤130M parameters) developed by Divakant Pandey. Specialized for semantic code search, code retrieval, and repository navigation with 8,192 token context and Matryoshka representation learning.

🚀 Key Features

  • Author / Maintainer: Divakant Pandey
  • Backbone: UniXcoder bi-encoder architecture with a 2-layer MLP projection head and unit-sphere L2 normalization.
  • 3-Stage Curriculum:
    1. SimCSE Unsupervised Contrastive Learning (uniformity on hypersphere).
    2. Supervised Fine-Tuning (MNRL with BM25 lexical hard negatives).
    3. Matryoshka Representation Learning (MRL) (nested dimensions: 64, 128, 256, 384, 768, 1536).
  • Fast CPU Inference: ~20.8 ms per code snippet on standard laptop CPU.
  • Production-Ready: Exportable to ONNX with dynamic axes and dynamic INT8 quantization.

📊 Benchmark Results

Benchmark Metric Value Gate Status
CodeSearchNet (Python) MRR@10 0.7514 PASS (≥ 0.65)
CoSQA (Code Search QA) MRR@10 0.7509 PASS (≥ 0.50)
Hypersphere Uniformity Uniformity -1.9758 PASS (≤ -1.0)
Single-Snippet Latency CPU Latency 20.8 ms PASS (< 100 ms)

💻 Quickstart Usage

With Sentence-Transformers:

from sentence_transformers import SentenceTransformer

# Automatically downloads from Hugging Face Hub
model = SentenceTransformer("divakantpandey/code-embed")

queries = ["binary search in sorted list", "read json file"]
snippets = [
    "def binary_search(arr, target): ...",
    "import json\ndef load_json(path): return json.load(open(path))"
]

query_embeddings = model.encode(queries, normalize_embeddings=True)
code_embeddings = model.encode(snippets, normalize_embeddings=True)

# Compute cosine similarity
similarities = query_embeddings @ code_embeddings.T
print(similarities)

📜 License & Commercial Inquiries

This model and its weights are released under the Creative Commons Attribution-NonCommercial 4.0 International (CC-BY-NC 4.0) license.

  • Non-Commercial Use: Free for academic research, education, benchmarking, and non-commercial projects with attribution.
  • Attribution: Please cite Divakant Pandey and link to https://github.com/divakantpandey/code-embed.
  • Commercial Licensing: To use this model in commercial applications, proprietary software, enterprise APIs, or SaaS products, please contact:
    • Maintainer: Divakant Pandey
    • Email: divakant01@gmail.com
    • GitHub: @divakantpandey