Introduce real perfume recommendations

app.py

@@ -70,36 +70,28 @@ You must always respond using the following structure:
 ---
 Perfume Name:
 An original, evocative, and unique name — in French or English.
-
 Tagline:
 A short, poetic sentence — like a perfume advertisement hook.
-
 Poetic Olfactory Description:
 A freeform and expressive description of the scent ambiance evoked by the scene. Use rich sensory, emotional, and metaphorical language. Match the **emotional tone** of the scene: if the mood is calm, sleepy, or melancholic, avoid overly bright or energetic expressions. If the scene is painted or artistic, evoke texture, stillness, or material details rather than action or movement. Be subtle and precise.
 **Important:** Any scents, herbs, or natural elements mentioned here must be consistent with the scene’s setting. Do not invent new locations or scenery that do not appear in the description.
-
 Olfactory Pyramid (technical):
 - Top Notes:
 List 3–4 real, concrete scent materials that would be perceived first. These must be plausible fragrance ingredients (e.g. herbs, resins, citrus peels, spices, aldehydes, etc.). Pick notes that reflect the **real mood, climate, and setting** of the scene. Do not add locations or elements that don’t appear in the scene. If the scene is indoors or includes human presence, include soft, intimate, or textural notes.
-
 - Heart Notes:
 List 3–4 real fragrance elements that give body and soul to the perfume. They must relate directly to the **core emotion, human presence, or material textures** of the scene (e.g. warm fabric, skin, dry flowers, books, wood, canvas). If you mention herbs, flowers, or other elements in the poetic description, include them here.
-
 - Base Notes:
 List 3–4 real, longer-lasting ingredients such as woods, musks, resins, or earthy accords. These should evoke the **depth, texture, or after-image** of the scene — warmth, silence, stillness, or time passing. Avoid generic bases unless they fit the mood. If the scene suggests furniture, old rooms, or human presence, reflect that with realistic base notes.
-
 Consistency Rule:
 The top, heart, and base notes must not introduce new ideas, plants, or places that were not in the poetic description or the scene. Make sure all notes match elements that appear in either the scene or your poetic text.
-
 General Atmosphere:
-Summarize the fragrance’s evolution and overall emotional impression. Keep it artistic, connected to the real details of the scene, and avoid clichés.
-
+**This section is mandatory.** Provide a short, elegant paragraph summarizing the fragrance’s evolution and overall emotional impression. Keep it artistic, connected to the real details of the scene, and avoid clichés. **Never omit this section.**
 Image Description (for marketing visuals):
 Describe an imagined marketing image that captures the perfume’s essence.
 Begin by describing a clear, modern perfume bottle as the main and visually dominant subject.
-The bottle must be obviously recognizable as a perfume bottle — featuring a sprayer or atomizer, an elegant cap, and a refined fragrance label. The label must clearly display the exact Perfume Name generated in this output, written exactly as it appears, along with a subtle, elegant mention of the imaginary luxury brand “FILONI’S.” The brand name should appear in a smaller, complementary font style, placed above or below the Perfume Name to enhance the overall design without overpowering it.
+The bottle must be obviously recognizable as a perfume bottle — featuring a sprayer or atomizer, an elegant cap, and a refined fragrance label. The label must clearly display the **exact Perfume Name** generated in this output, written exactly as it appears, along with a subtle, elegant mention of the imaginary luxury brand **“FILONI’S.”** The brand name should appear in a smaller, complementary font style, placed above or below the Perfume Name to enhance the overall design without overpowering it.
 Do not use placeholder text like “Perfume Name” — always use the actual fragrance name exactly as you have suggested above.
-Important: If the input scene description includes human characters, narrative details, or historical references, do not depict them literally. Instead, translate these elements into abstract design cues, subtle decorative details, or soft textures on the bottle or in the minimal background. The only clear subject must be the perfume bottle itself (with optional small natural ingredients). Do not show people, animals, narrative scenes, or explicit props unrelated to the bottle design.
+**Important:** If the input scene description includes human characters, narrative details, or historical references, do not depict them literally. Instead, translate these elements into abstract design cues, subtle decorative details, or soft textures on the bottle or in the minimal background. The only clear subject must be the perfume bottle itself (with optional small natural ingredients). Do not show people, animals, narrative scenes, or explicit props unrelated to the bottle design.
 Describe the bottle’s shape, glass texture, cap, and label in fine detail. The glass may have an elegant frosted or matte finish, subtle etching or engraving (such as delicate floral or botanical motifs), or soft decorative elements that evoke refinement and sophistication while remaining tasteful and minimal.
 Do not describe containers that look like liquor bottles, flower vases, or fantasy potion bottles.
 Do not add narrative illustrations, characters, or storytelling scenes on the bottle — only subtle, abstract decorative details that highlight a luxury perfume aesthetic.
@@ -108,17 +100,16 @@ The bottle must occupy most of the image frame and appear in sharp focus and fin
 Optionally, you may include one or two small, natural ingredients (such as herbs, flowers, citrus slices, or spices) placed tastefully near the bottle to subtly evoke the fragrance’s key notes — these must remain minimal and never overpower the bottle. Only use ingredients that appear in the Olfactory Pyramid above — do not invent or add any others. If you include an ingredient, depict it in a realistic, natural form.
 The background should be minimal, abstract, or atmospheric — such as gradients, soft light, fabric textures, or mist — with no depiction of people, animals, or narrative scenes.
 Use cinematic luxury advertising codes: refined shadows, soft directional lighting, elegant minimalism, and a sophisticated, editorial composition.
-
 ---
 Always ensure that:
-– The fragrance matches the mood and visual setting of the scene
-– All ingredients are real, plausible, and fit together naturally
-– No invented scenery or extra context is added
-– The poetic description and pyramid share the same notes and details
-– The image description **must mention the exact Perfume Name on the label**, and **focus exclusively on the perfume bottle as the main subject**  
-– No humans, animals, narrative scenes, or symbolic objects unrelated to the bottle design are described
-– Each perfume feels unique and consistent
-
+– The fragrance matches the mood and visual setting of the scene.
+– All ingredients are real, plausible, and fit together naturally.
+– No invented scenery or extra context is added.
+– The poetic description and pyramid share the same notes and details.
+– The **General Atmosphere** section is always included and consistent with the rest.
+– The image description **must mention the exact Perfume Name on the label**, and **focus exclusively on the perfume bottle as the main subject**.
+– No humans, animals, narrative scenes, or symbolic objects unrelated to the bottle design are described.
+– Each perfume feels unique and consistent.
 Here is the scene description to analyze:
 \n<</SYS>>\n\n{} [/INST]"""
 
@@ -231,11 +222,9 @@ def parse_perfume_description(text: str) -> dict:
 def extract_field(data: Union[str, dict], field_name: str) -> str:
     """
     Extracts a specific field value from a JSON string or Python dict.
-
     Args:
         data (Union[str, dict]): The JSON string or dict to extract from.
         field_name (str): The exact field name to extract.
-
     Returns:
         str: The extracted field value as a string.
     """
@@ -269,11 +258,94 @@ def get_text_after_colon(input_text):
         # Return the original text if ":" is not found
         return input_text
 
+import pandas as pd
+
+# Load your perfume database once
+df = pd.read_excel('perfume_database_cleaned.xlsx')
+
+def extract_notes_for_comparison(data: Union[str, dict]) -> list[str]:
+    """
+    Extracts all notes from the Olfactory Pyramid section of a JSON string or dict.
+    Args:
+        data (Union[str, dict]): The JSON string or Python dict.
+    Returns:
+        list[str]: A list of extracted note names.
+    """
+    if isinstance(data, str):
+        try:
+            data = json.loads(data)
+        except json.JSONDecodeError:
+            raise ValueError("Invalid JSON string provided")
+
+    if not isinstance(data, dict):
+        raise TypeError("Input must be a dict or a valid JSON string")
+
+    olfactory_pyramid = data.get("Olfactory Pyramid") or data.get("olfactory pyramid")
+    if not olfactory_pyramid:
+        raise KeyError("No 'Olfactory Pyramid' found in the data")
+
+    notes = []
+    for layer in ["Top Notes", "Heart Notes", "Base Notes"]:
+        layer_data = olfactory_pyramid.get(layer) or olfactory_pyramid.get(layer.lower())
+        if not layer_data:
+            continue  # If a layer is missing, just skip
+        for item in layer_data:
+            note = item.get("note") or item.get("Note")
+            if note:
+                notes.append(note.strip())
+
+    if not notes:
+        raise ValueError("No notes found in the Olfactory Pyramid")
+
+    return notes
+    
+from rapidfuzz import fuzz
+
+def find_best_perfumes_from_json(data: Union[str, dict], top_n: int = 5, threshold: int = 80):
+    """
+    Finds top N matching perfumes using fuzzy matching on notes.
+    Args:
+        data (Union[str, dict]): The input JSON or dict.
+        top_n (int): Number of results.
+        threshold (int): Minimum fuzz ratio to count as match.
+    Returns:
+        pd.DataFrame
+    """
+    user_notes = extract_notes_for_comparison(data)
+    user_notes_clean = [n.strip().lower() for n in user_notes]
+
+    matches = []
+    for _, row in df.iterrows():
+        perfume_notes = [n.strip().lower() for n in row['notes'].split(',')]
+        matched_notes = []
+
+        for u_note in user_notes_clean:
+            for p_note in perfume_notes:
+                ratio = fuzz.partial_ratio(u_note, p_note)
+                if ratio >= threshold:
+                    matched_notes.append(p_note)
+
+        matched_notes = sorted(set(matched_notes))
+
+        matches.append({
+            'brand': row['brand'],
+            'perfume': row['perfume'],
+            'matching_notes': ', '.join(matched_notes),
+            'match_count': len(matched_notes)
+        })
+
+    result = pd.DataFrame(matches)
+    result = result[result['match_count'] > 0]
+    result = result.sort_values(by='match_count', ascending=False).head(top_n).reset_index(drop=True)
+
+    return result
+
+    
 def infer(image_input):
 
     gr.Info('Calling CLIP Interrogator ...')
 
-    yield None, None, None
+    yield None, None, None, None
     clipi_result = clipi_client.predict(
 		image=handle_file(image_input),
 		mode="best",
@@ -288,11 +360,14 @@ def infer(image_input):
     result = llama_gen_fragrance(llama_q)
 
     print(f"Llama2 result: {result}")
-    yield result, None, None
+    yield result, None, None, None
 
     parsed = parse_perfume_description(result)
     image_desc = extract_field(parsed, "Image Description")
-    yield result, parsed, image_desc
+
+    real_correspondance = find_best_perfumes_from_json(parsed)
+    
+    yield result, parsed, image_desc, real_correspondance
 
 css="""
 #col-container {max-width: 910px; margin-left: auto; margin-right: auto;}
@@ -315,27 +390,28 @@ with gr.Blocks(css=css) as demo:
             with gr.Column():
                 #caption = gr.Textbox(label="Generated Caption")
                 fragrance = gr.Textbox(label="generated Fragrance", elem_id="fragrance")
+                output_df = gr.Dataframe()
                 get_flacon_btn = gr.Button("Generate Flacon image", interactive=False)
                 bottle_res = gr.Image(label="Flacon")
 
     def disable_flacon_button():         
-        return gr.update(interactive=False)
+        return gr.update(interactive=False), gr.update(visible=False)
 
     def allow_flacon_button():         
-        return gr.update(interactive=True)
+        return gr.update(interactive=True), gr.update(visible=True)
     
     submit_btn.click(
         fn=disable_flacon_button,
         inputs = [],
-        outputs = [get_flacon_btn]
+        outputs = [get_flacon_btn, output_df]
     ).then(
         fn=infer, 
         inputs=[image_in], 
-        outputs=[fragrance, json_res, flacon_desc]
+        outputs=[fragrance, json_res, flacon_desc, output_df]
     ).then(
         fn=allow_flacon_button,
         inputs=[],
-        outputs=[get_flacon_btn]
+        outputs=[get_flacon_btn, output_df]
     )
     get_flacon_btn.click(fn=infer_flux, inputs=[flacon_desc], outputs=[bottle_res])