Combinatorial Optimization with LLMs/Transformers

I am curious whether a well-designed Transformer can do something like a job-shop-scheduling problem (JSSP) at the high level as GA and other heuristical approaches.

The logic I am coming from is that words are sequences, and JSSP can be transformed into a sequence of tasks no matter what the precedence graph looks like. And final solution would be set of tasks, as LLM makes a set of words that make a story…

I did find some literature on this, but problems are usually very small - like few dozens of tasks with very simple/streamlined rules.

1 Like

Yes I’d be very interested in this as well :slight_smile:

1 Like

Does the data in JSSP scale up now, like millions pieces of job shop schedules?

I’m interested in LLM4CO too! Could you share the literature about the topic please ?