Skip to content
View alperiox's full-sized avatar

Block or report alperiox

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
alperiox/README.md

ezgif-2-6c86a22e466b

About me!

Hello! I'm Alper,

I'm a research engineer, worked on multimodal models, llms, diffusion models, stt/tts for low-resource languages and domains (Turkish, telephony, etc). My background is in mathematics, thus I'm really interested in math-heavy part of the deep learning too. I like to practice interpretability and efficiency in LLMs and generative models. I'm particularly interested in transformer-based models, diffusion models, and mechanistic interpretability. Currently I'm interested in:

  • Mechanistic interpretability of generative models
  • Efficiency: pruning, distillation, quantization for LLMs and diffusion
  • Architecture-level analysis of transformers and diffusion models
  • GPU systems and inference optimization
  • Low-resource multilingual speech modeling (as prior specialty)

Languages

Python

Libraries

PyTorch Tensorflow 2 Keras Scikit-Learn

Other Libraries

Numpy Pandas Scipy Matplotlib Seaborn Plotly

Technologies

Git AWS Docker Windows

GitHub Stats GitHub Stats

Pinned Loading

  1. Compact-Language-Models-via-Pruning-and-Knowledge-Distillation Compact-Language-Models-via-Pruning-and-Knowledge-Distillation Public

    Unofficial implementation of https://arxiv.org/pdf/2407.14679

    Python 53 11

  2. bookbot bookbot Public

    A toy project for my generative AI studies on text data. Train generative models with given book/text files with just a single script.

    Python 1

  3. fastapi/fastapi fastapi/fastapi Public

    FastAPI framework, high performance, easy to learn, fast to code, ready for production

    Python 100k 9.6k

  4. huggingface/blog huggingface/blog Public

    Public repo for HF blog posts

    Jupyter Notebook 3.5k 1k

  5. huggingface/computer-vision-course huggingface/computer-vision-course Public

    This repo is the homebase of a community driven course on Computer Vision with Neural Networks. Feel free to join us on the Hugging Face discord: hf.co/join/discord

    Jupyter Notebook 861 241