Skip to content

Instantly share code, notes, and snippets.

@ruvnet
Last active August 18, 2025 21:14
Show Gist options
  • Select an option

  • Save ruvnet/56807c220f4d80a82b6e0e8b276f631b to your computer and use it in GitHub Desktop.

Select an option

Save ruvnet/56807c220f4d80a82b6e0e8b276f631b to your computer and use it in GitHub Desktop.
Diffusion-Based Coding Model with PyTorch
Display the source blob
Display the rendered blob
Raw
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@BradKML
Copy link

BradKML commented Aug 12, 2025

How far is this away from SOTA or established libraries? https://github.com/Jianguo99/OpenDLM

@alanchelmickjr
Copy link

https://deepmind.google/models/gemini-diffusion/

2 to 5 years before power catches up with shape and modern transformers are not needed (tokens get huge oc in a multi vector token)

Currently a hybrid system that "augments" the text based system by giving it ultimate grounding. I've only tested on limited datasets so I can only product limited code. Attempting to research more...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment