Skip to content
View urosavurdic's full-sized avatar

Highlights

  • Pro

Block or report urosavurdic

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
urosavurdic/README.md

Uroš Savurdić

M.Sc. student in Electrical Engineering and Computer Science, and previously an Applied Science Intern at Microsoft. I work on machine learning systems and the evaluation infrastructure around them — the part that tells you whether a model actually does what you claim it does.

Most of what I build falls into three groups: interpretability and safety research on language models, retrieval and representation learning, and performance work close to the hardware.

Selected work

Project What it is
DPO safety representations Does DPO build a new safety representation, or amplify one the base model already had? Probing and steering a refusal direction across a Base → SFT → DPO chain.
Attention mechanism paradigms Attention on 12 execution substrates and 17 implementations, measured and modelled stage by stage. Softmax is 0.4% of the FLOPs and up to 35% of the measured runtime; a silent float64 promotion under NumPy 2 made FP32 look 20× slower.
Optimization methods Six optimisation problems from scratch in NumPy — metaheuristics, derivative-free fitting, and backpropagation raced against a genetic algorithm.
Code search engine Semantic code search over CoSQA. A bi-encoder fine-tuned with InfoNCE lifts MRR@10 from 0.79 to 0.91.
Written text recognizer Handwritten paragraph recognition, ResNet encoder into a Transformer decoder, served over FastAPI.

Tools

Python · PyTorch · PyTorch Lightning · NumPy · JAX · scikit-learn · FAISS · FastAPI · Docker · CUDA · MATLAB

Elsewhere

Portfolio · LinkedIn

Pinned Loading

  1. dpo-safety-representations dpo-safety-representations Public

    Does DPO build a new safety representation, or amplify one the base model already had? Tracing a refusal direction across a Base to SFT to DPO chain.

    Python

  2. attention-mechanism-paradigms attention-mechanism-paradigms Public

    Attention on 12 execution substrates and 17 implementations - 8 measured on CPU/T4/TPU, 9 analytical cost models. Softmax is 0.4% of FLOPs and up to 35% of runtime; a silent NumPy 2 float64 promoti…

    Python

  3. embeddings-based-code-search-engine embeddings-based-code-search-engine Public

    Semantic code search over CoSQA: a bi-encoder fine-tuned with InfoNCE, a FAISS index and a FastAPI demo. MRR@10 0.79 to 0.91.

    Jupyter Notebook

  4. written-text-recognizer written-text-recognizer Public

    Handwritten paragraph recognition: ResNet encoder plus Transformer decoder, served over FastAPI. 0.38 CER on IAM.

    Jupyter Notebook