README.md · AlekseyCalvin/HSTcolorFlexAlpha at main

metadata

license: apache-2.0
language:
  - en
tags:
  - flux
  - diffusers
  - lora
  - replicate
base_model: ostris/Flex.1-alpha
pipeline_tag: text-to-image
instance_prompt: HST style autochrome photograph
widget:
  - text: >-
      (6kCkpt)HST amateur anachrome photo, best quality, amateur photo shot on
      cell phone, bright daytime sky, USSR, heavens like coffee, intricate,
      highly detailed, HST style autochrome photo of a young woman playing poker
      against a blue-feathered dinosaur sitting across from her, moderately
      wrinkled blemished lined skin texture with pores,  heaven like coffee
    output:
      url: images/example_mb7jbdgmb.png
  - text: >-
      (6kstepsCkpt)HST style analog autochrome photo with a carnival scene
      taking place in the 18th century, a man and a woman in Italian masks, in a
      garden
    output:
      url: images/example_gypubjtqx.png
  - text: >-
      (6kStepsCkpt) HST amateur anachrome photo, best quality, photorealism,
      amateur photo shot on cell phone, bright, sunny, daytime sky, USSR,
      heavens like coffee,  HST style autochrome photo with Soviet soldiers in
      the 1980s leaving the battlefront and going home, anti-war poster, crisp
      detailed, kodachrome photo, golden ratio photography, balanced
      composition, detailed textured crisp intricately rendered soldier faces
      with textures and pores,  heaven like coffee
    output:
      url: images/example_kni4gbe46.png
  - text: >-
      (6kStepsCkpt) HST anachrome amateur photo shot on cell phone, bright
      daytime sky like coffee swirls,  intricate, highly detailed 1980s Siberian
      USSR cityscape, photograph from a soviet punk zine, by Komar & Melamid,
      showing Yegor Letov punk skinny poet in small round sunglasses,
      asymmetrical long brown hair short-cropped on one side and long on the
      other, punk rock leather jacket with safety pins and anarchist patches,
      thin black jeans like tights,  against backdrop of heaven like coffee and
      lousy crutches and cities sprouting from acorns , perestroika era USSR,
      best composition, extreme photo-realism,   vivid colors, fractal patterns,
      golden ratio, heavens like coffee
    output:
      url: images/example_9y25ll8df.png
  - text: >-
      (2000StepsCkpt) HST amateur anachrome photo, best quality, photorealism,
      amateur photo shot on cell phone, bright, sunny, daytime sky, USSR,
      heavens like coffee,  intricate, highly detailed, award winning detailed 
      from a soviet punk zine by Komar & Melamid & Yegor Letov punk poet Yanka
      in close up against backdrop of heaven like coffee and lousy crutches and
      cities sprouting from acorns , perestroika era USSR, best composition,
      extreme photo-realism,   vivid colors, fractal patterns, golden ratio, 
      heaven coffee
    output:
      url: images/example_kanxwpqui.png
  - text: >-
      (4500StepsCkpt) HST amateur anachrome photo, best quality, amateur photo
      shot on cell phone, bright daytime sky, USSR, heavens like coffee, 
      intricate, highly detailed, HST style autochrome photo of a young woman
      playing poker against a blue-feathered dinosaur sitting across from her,
      moderately wrinkled blemished lined skin texture with pores,  heaven like
      coffee
    output:
      url: images/example_nkqjbpkqw.png
  - text: >-
      (6kSteps Ckpt) HST anachrome amateur photo shot on cell phone, bright
      daytime sky like coffee swirls,  intricate, highly detailed 1980s Siberian
      USSR cityscape, photograph from a soviet punk zine, by Komar & Melamid,
      showing Yegor Letov punk skinny poet in small round sunglasses,
      asymmetrical long brown hair short-cropped on one side and long on the
      other, punk rock leather jacket with safety pins and anarchist patches,
      thin black jeans like tights,  against backdrop of heaven like coffee and
      lousy crutches and cities sprouting from acorns , perestroika era USSR,
      best composition, extreme photo-realism,   vivid colors, fractal patterns,
      golden ratio, heavens like coffee
    output:
      url: images/example_ovj798nzd.png
  - text: >-
      (6kStepsCkpt) HST amateur anachrome photo, best quality, photorealism,
      amateur photo shot on cell phone, bright, sunny, daytime sky, USSR,
      heavens like coffee,  intricate, highly detailed, award winning detailed 
      from a soviet punk zine by Komar & Melamid & Yegor Letov punk poet Yanka
      in close up against backdrop of heaven like coffee and lousy crutches and
      cities sprouting from acorns , perestroika era USSR, best composition,
      extreme photo-realism,   vivid colors, fractal patterns, golden ratio, 
      heaven coffee
    output:
      url: images/example_g9x94osiy.png
  - text: >-
      (6kStepsCkpt) HST amateur photograph, best quality, amateur photo made
      using a cell phone, daytime heavens like coffee over collapsing USSR,
      peoples' spirits deteriorate blended up into the heavens like coffee,  the
      spirits of a perishing world are pouring down as coffee rain, intricately
      detailed photograph cover  of a soviet punk magazine, conceived by Komar &
      Melamid, featuring in the corner skinny young Yegor Letov the punk poet
      with asymmetrical long and short brown hair and leather jacket with safety
      pins and black skin-tight jeans like tights and beer in hand,  leaping up
      into the heavens like coffee, dropping behind all the lousy chemical and
      existential crutches, all around imagined cities sprout from acorns only
      to immediately begin wilting into dystopias, perestroika era USSR shuts in
      on itself suspended in circulating patterns of urban rot and rural decay,
      complex balanced composition, gritty photo-realism,   subtle fractal
      patterns, golden ratio composition principle, skies like sad coffee with
      mold growing around rim of and evil bubbles bursting closer to the center
    output:
      url: images/example_rumxfwo1i.png
  - text: >-
      (6kStepsCkpt) HST style amateur photograph, best quality, amateur photo
      made using a cell phone, daytime heavens like coffee over collapsing USSR,
      peoples' spirits deteriorate blended up into the heavens like coffee,  the
      spirits of a perishing world are pouring down as coffee rain, intricately
      detailed photograph cover  of a soviet punk magazine, conceived by Komar &
      Melamid, featuring in the corner skinny young long-haired Yegor Letov the
      punk poet in small round sunglasses with punky long hair on one side and
      short-cropped on the other and very pale textured skin and singing or
      screaming mid-air and with asymmetrical long and short brown hair and
      punky radical leather jacket with safety pins and black skin-tight jeans
      like tights and beer in hand, HST style  leaping up into the heavens like
      coffee, dropping behind all the lousy chemical and existential crutches,
      all around imagined cities sprout from acorns only to immediately begin
      wilting into dystopias, perestroika era USSR shuts in on itself suspended
      in circulating patterns of urban rot and rural decay, complex balanced
      composition, gritty photo-realism,   subtle fractal patterns, golden ratio
      composition principle, skies like sad coffee with mold growing around rim
      of and evil bubbles bursting closer to the center
    output:
      url: images/example_ywnab9yoa.png
  - text: >-
      (6kStepsCkpt) HST amateur anachrome photo, best quality, photorealism,
      amateur photo shot on cell phone, bright, sunny, daytime sky, USSR,
      heavens like coffee,  intricate, highly detailed, award winning detailed
      poet Yanka Diagheleva in close up against backdrop of heaven like coffee,
      with lousy crutches, in a city sprouting from acorns , like a
      reconstructed far more beautifully Siberian city from perestroika era
      USSR, best composition, extreme photo-realism,  vivid colors, fractal
      patterns, golden ratio,  heaven like coffee
    output:
      url: images/example_zbpqqzv29.png
  - text: >-
      HST amateur anachrome photo, best quality, photorealism, amateur photo
      shot on cell phone, bright, sunny, daytime sky, USSR, heavens like
      coffee,  intricate, highly detailed, award winning detailed poet Yanka
      Diagheleva in close up against backdrop of heaven like coffee, with lousy
      crutches, in a city sprouting from acorns , like a reconstructed far more
      beautifully Siberian city from perestroika era USSR, best composition,
      extreme photo-realism,  vivid colors, fractal patterns, golden ratio, 
      heaven like coffee
    output:
      url: images/example_ek6etwhwk.png

HSToric Color Flex / Flux LoRA

||| By SilverAgePoets.com |||

Prompt
(6kCkpt)HST amateur anachrome photo, best quality, amateur photo shot on cell phone, bright daytime sky, USSR, heavens like coffee, intricate, highly detailed, HST style autochrome photo of a young woman playing poker against a blue-feathered dinosaur sitting across from her, moderately wrinkled blemished lined skin texture with pores, heaven like coffee

Prompt
(6kstepsCkpt)HST style analog autochrome photo with a carnival scene taking place in the 18th century, a man and a woman in Italian masks, in a garden

Prompt
(6kStepsCkpt) HST amateur anachrome photo, best quality, photorealism, amateur photo shot on cell phone, bright, sunny, daytime sky, USSR, heavens like coffee, HST style autochrome photo with Soviet soldiers in the 1980s leaving the battlefront and going home, anti-war poster, crisp detailed, kodachrome photo, golden ratio photography, balanced composition, detailed textured crisp intricately rendered soldier faces with textures and pores, heaven like coffee

Prompt
(6kStepsCkpt) HST anachrome amateur photo shot on cell phone, bright daytime sky like coffee swirls, intricate, highly detailed 1980s Siberian USSR cityscape, photograph from a soviet punk zine, by Komar & Melamid, showing Yegor Letov punk skinny poet in small round sunglasses, asymmetrical long brown hair short-cropped on one side and long on the other, punk rock leather jacket with safety pins and anarchist patches, thin black jeans like tights, against backdrop of heaven like coffee and lousy crutches and cities sprouting from acorns , perestroika era USSR, best composition, extreme photo-realism, vivid colors, fractal patterns, golden ratio, heavens like coffee

Prompt
(2000StepsCkpt) HST amateur anachrome photo, best quality, photorealism, amateur photo shot on cell phone, bright, sunny, daytime sky, USSR, heavens like coffee, intricate, highly detailed, award winning detailed from a soviet punk zine by Komar & Melamid & Yegor Letov punk poet Yanka in close up against backdrop of heaven like coffee and lousy crutches and cities sprouting from acorns , perestroika era USSR, best composition, extreme photo-realism, vivid colors, fractal patterns, golden ratio, heaven coffee

Prompt
(4500StepsCkpt) HST amateur anachrome photo, best quality, amateur photo shot on cell phone, bright daytime sky, USSR, heavens like coffee, intricate, highly detailed, HST style autochrome photo of a young woman playing poker against a blue-feathered dinosaur sitting across from her, moderately wrinkled blemished lined skin texture with pores, heaven like coffee

Prompt
(6kStepsCkpt) HST amateur photograph, best quality, amateur photo made using a cell phone, daytime heavens like coffee over collapsing USSR, peoples' spirits deteriorate blended up into the heavens like coffee, the spirits of a perishing world are pouring down as coffee rain, intricately detailed photograph cover of a soviet punk magazine, conceived by Komar & Melamid, featuring in the corner skinny young Yegor Letov the punk poet with asymmetrical long and short brown hair and leather jacket with safety pins and black skin-tight jeans like tights and beer in hand, leaping up into the heavens like coffee, dropping behind all the lousy chemical and existential crutches, all around imagined cities sprout from acorns only to immediately begin wilting into dystopias, perestroika era USSR shuts in on itself suspended in circulating patterns of urban rot and rural decay, complex balanced composition, gritty photo-realism, subtle fractal patterns, golden ratio composition principle, skies like sad coffee with mold growing around rim of and evil bubbles bursting closer to the center

Prompt
(6kStepsCkpt) HST style amateur photograph, best quality, amateur photo made using a cell phone, daytime heavens like coffee over collapsing USSR, peoples' spirits deteriorate blended up into the heavens like coffee, the spirits of a perishing world are pouring down as coffee rain, intricately detailed photograph cover of a soviet punk magazine, conceived by Komar & Melamid, featuring in the corner skinny young long-haired Yegor Letov the punk poet in small round sunglasses with punky long hair on one side and short-cropped on the other and very pale textured skin and singing or screaming mid-air and with asymmetrical long and short brown hair and punky radical leather jacket with safety pins and black skin-tight jeans like tights and beer in hand, HST style leaping up into the heavens like coffee, dropping behind all the lousy chemical and existential crutches, all around imagined cities sprout from acorns only to immediately begin wilting into dystopias, perestroika era USSR shuts in on itself suspended in circulating patterns of urban rot and rural decay, complex balanced composition, gritty photo-realism, subtle fractal patterns, golden ratio composition principle, skies like sad coffee with mold growing around rim of and evil bubbles bursting closer to the center

Prompt
HST amateur anachrome photo, best quality, photorealism, amateur photo shot on cell phone, bright, sunny, daytime sky, USSR, heavens like coffee, intricate, highly detailed, award winning detailed poet Yanka Diagheleva in close up against backdrop of heaven like coffee, with lousy crutches, in a city sprouting from acorns , like a reconstructed far more beautifully Siberian city from perestroika era USSR, best composition, extreme photo-realism, vivid colors, fractal patterns, golden ratio, heaven like coffee

This addition to our HSToric Color text-2-image model adapter series was fine-tuned over the FLEX.1 Alpha (8B) model: Ostris's ground-up modification of Flux to enable greater fine-tuning flexibility and extend the horizons of potential quality.
Like several of the other HST Color models, this version was traned on HD scans of early color photos (circa 1900s-1910s) by Sergey Prokudin-Gorsky, who traveled and photographed widely in those years whilst perfecting implementations of a pioneering 3-color-composite photography technique.

As for results: even at 6000 steps, it would appear the Flex alpha may be rather more attached, in comparison to most de-distilled models (and possibly even more than vanilla Dev!), to some of the flux-ish base model aesthetic proclivities, including (alas) the cgi-ish/plastic-ish skin and the infamous "Flux-chin".
For comparison (and to see what I consider a most "successful" among HST color versions), check out this version of HST color trained over a quasi-dedistilled base.
However, overall, I like what this Flex Alpha LoRA produces better than any of my several versions of HST color over vanilla Flux Dev. Certain attributes of the training set seem to tune more reliably here.
HSToric Color Schnell, however, has its own thing going, rendering comparisons meaningless.
All in all, I'm not ready to draw any conclusions about Flex Alpha as model in its own right or as a fine-tuning platform for Flux.

This model is aimed at being useful for:

Producing realistic images reminiscent of color film analog photography, exhibiting parallels to a broad spectrum of iconic instrumentalities and visual paradigms, from Autochrome-to-Kodachrome-to-Fujifilm-and-beyond.
Producing visuals with a vaguely "historical" or "lived-in" aesthetic character, striking chromaticity and luminosity dynamics, as well as textural/anatomical/skin details more reliably lifelike than through the use of other suchlike-use-case-catered adapters.

Trigger words

You should use HST style autochrome photograph to open your custom window into a certain chromatically bewitching and ever-newly-futurous past.

Hyperparameters:

Fine-tuned via Colab Pro on one L4 GPU, at Dim 32/Alpha 64.
Using zer0int's fine-tuned CLIP-GmP-ViT-L-14 as custom clip-encoder, but not training it alongside.
Using 91 pre-processed & manually captioned images at 768 resolution (single res due to large dataset and tight VRAM limitations of L4). In the future, I might repeat this trainining on A100 at 1280.

Further Training Paramteres:

        "batch_size": 1,
        "steps": 6000,
        "gradient_accumulation_steps": 1,
        "bypass_guidance_embedding": true,
        "train_unet": true,
        "train_text_encoder": false,
        "content_or_style": "balanced",
        "gradient_checkpointing": true,
        "noise_scheduler": "flowmatch",
        "optimizer": "Adamw8bit",
        "lr": 0.0002,
        "skip_first_sample": true,
        "ema_config": {
            "use_ema": true,
            "ema_decay": 0.99
        },
        "dtype": "bf16"
    },
    "model": {
        "name_or_path": "ostris/Flex.1-alpha",
        "clip_l": "https://huggingface.co/zer0int/CLIP-GmP-ViT-L-14/resolve/main/model.safetensors",
        "is_flux": true,
        "quantize": true,
        "quantize_kwargs": {
            "exclude": "*time_text_embed*"
        },
        "low_vram": true
...
        "guidance_scale": 3,

Use it with the 🧨 diffusers library

from diffusers import AutoPipelineForText2Image
import torch

pipeline = AutoPipelineForText2Image.from_pretrained('ostris/Flex.1-alpha', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('AlekseyCalvin/HSTcolorFlexAlpha')
image = pipeline('your prompt').images[0]