cad3dify

Using GPT-5 (or Claude 4.5 opus, Gemini 3 pro, Llama 3.2 on Vertex AI), generate a 3D CAD model (STEP file) from a 2D CAD image.

Note

We developed an agent-based version of this project called agent3dify. You can use it instead of this project.

Getting started

Installation.

git clone git@github.com:neka-nat/cad3dify.git
cd cad3dify
poetry install

Run script. A STEP`file ("output.step") will be generated.

cd scripts
export OPENAI_API_KEY=<YOUR API KEY>
python cli.py <2D CAD Image File>

Or run streamlit spp

streamlit run scripts/app.py
streamlit run scripts/app.py -- --model_type claude  # Use Claude 4.5 sonnet
streamlit run scripts/app.py -- --model_type gemini  # Use Gemini 3.0 pro preview
streamlit run scripts/app.py -- --model_type llama  # Use Llama 3.2 on Vertex AI

Architecture

graph TD
    Input((Input Image)) --> CodeGenerator(CAD Code Generator AI Agent)
    CodeGenerator --> PythonDebugger(Python Execution and Debugging AI Agent)
    PythonDebugger --> StepFile((STEP File))
    StepFile --> Rendering(Rendering 3D CAD Model Image from STEP File)
    Rendering --> Refiner(CAD Code Refiner AI Agent)
    Refiner --> PythonDebugger

Loading

Demo

We will use the sample file here.

Input image

Generated 3D CAD model