--- language: - en license: apache-2.0 tags: - sentence-transformers - sentence-similarity - feature-extraction - generated_from_trainer - dataset_size:800 - loss:TripletLoss base_model: nomic-ai/modernbert-embed-base widget: - source_sentence: Engineering Services. Executive Senior Manager (Managering Procurement). The Senior Engineer (Engineering Procurement) is responsible for managing procurement operations for the organisation's projects. He/She ensures adherence to quality standards in all procurement activities and processes, and further improves the procurement processes by proposing sourcing strategies and suggesting improvement initiatives to enhance the organisation's ability for timely delivery on projects. He manages a team of engineers and ensures efficient business operations.He typically comes from an engineering background. He is comfortable engaging and interacting with vendors and other external parties to manage the vendor selection and evaluation processes, as well as vendor relationships and performance. As an experienced worker with both engineering and procurement expertise, he may also be called upon to preparing training materials to develop the team's procurement capabilities. sentences: - Senior Engineer (Engineering Procurement) - Senior Nurse Clinician - Hotel and Accommodation Services. Senior Linen Room Attendant / Laundry Valet Attendant. The Linen Room Attendant/Laundry Valet Attendant performs daily assigned duties to support the day-to-day laundry, linen and uniform room operations, ensuring the delivery of clean garments, uniforms, towels and linens to all internal and external customers. He/She collects and delivers guest laundry, performs laundry cleaning, sorts and issues linens and uniforms, and assists in inventory count. He also cleans and maintains laundry equipment and the work area.As part of service delivery, the Linen Room Attendant/Laundry Valet Attendant has to handle guests' requests and respond to their concerns and feedback in a professional and courteous manner. He complies with organisational guidelines and regulations on hygiene and workplace safety and health, and reports safety hazards observed to ensure workplace safety and security.He is a team player with a high level of attentiveness to details and good communication skills to interact with guests and all levels of staff. He works on shifts, including weekends and public holidays. He is physically fit to meet the physical demands of the job which may involve constant standing, walking and lifting of heavy laundry and linen loads during a shift. - source_sentence: Social Service. Analyst Master Social Worker. The Master Social Worker works in the field of social work. He/She has expertise in social work domains and assists in supervising the delivery of interventions and programmes at the cluster or sub-sector level, driving community development work and uplifting the professional practice in social work. He strengthens partnership with key influencers within the community and across the organisation to guide the development of social service for various clients. He is also in charge of overseeing casework and group work intervention as well as providing strategic leadership to develop community development programmes. He initiates professional development projects for staff.A highly experienced professional with excellent management and leadership skills, the Master Social Worker inspires staff in their field of work. He works in institutional settings, communities, voluntary welfare organisations and hospitals. He leads collaborations with other agencies and ministries in the course of his work. sentences: - Air Transport. Senior Baggage Services Assistant. The Baggage Services Assistant operates automated baggage handling systems, Automated Guided Vehicles/Autonomous Vehicles (AGV/AVs) and conveyors to load and unload baggage from aircraft. He/She carries out checks on baggage to ensure there are no hazardous materials and dangerous goods. He tows, loads and unloads baggage containers. He adheres to individual safety and/or security standards in the workplace and reports breaches in safety and/or security standards.A Class 3 Driving Licence and an Airfield Driving Permit (ADP) are required of the Baggage Services Assistant to operate vehicles and conveyors. He works outdoors under all weather conditions as well as works in shifts to accommodate round-the-clock flight arrivals and departures. He is also physically strong and is familiar with baggage handling systems and processes. In addition, he has good time management and communication skills in order to work effectively with the team and carry out his duties. - Master Social Worker - Principal Engineer / Engineering Manager (Mechanical and Electrical) - source_sentence: BioPharmaceuticals Manufacturing. Associate Process Development / MS&T Executive. The Process Development/MS&T Manager reviews the operational and financial viability of developing, monitoring and improving biopharmaceuticals manufacturing processes within the facilities. He/She translates the departments objectives and priorities into actionable operating plans and Key Performance Indicators (KPIs) for Process Development/MS&T teams and tracks the progress. He is responsible for optimising internal processes while keeping in line with external guidelines and managing risks for the department. The Process Development/MS&T Manager is responsible for facilitating cross-departmental collaboration in order to successfully implement large-scale manufacturing processes for new biopharmaceuticals products or significant changes to equipment, systems and processes for existing products.The Process Development/MS&T Manager is expected to serve as a role model in the department and should be a personable and inspiring leader who can communicate well to influence internal and external stakeholders. He should be a champion for innovation and particularly enjoys leading efficiency and improvement initiatives across the organisation. sentences: - Director of Sales and Marketing - Process Development / MS&T Manager - Hotel and Accommodation Services. Associate Linen Room Attendant / Laundry Valet Attendant. The Linen Room Attendant/Laundry Valet Attendant performs daily assigned duties to support the day-to-day laundry, linen and uniform room operations, ensuring the delivery of clean garments, uniforms, towels and linens to all internal and external customers. He/She collects and delivers guest laundry, performs laundry cleaning, sorts and issues linens and uniforms, and assists in inventory count. He also cleans and maintains laundry equipment and the work area.As part of service delivery, the Linen Room Attendant/Laundry Valet Attendant has to handle guests' requests and respond to their concerns and feedback in a professional and courteous manner. He complies with organisational guidelines and regulations on hygiene and workplace safety and health, and reports safety hazards observed to ensure workplace safety and security.He is a team player with a high level of attentiveness to details and good communication skills to interact with guests and all levels of staff. He works on shifts, including weekends and public holidays. He is physically fit to meet the physical demands of the job which may involve constant standing, walking and lifting of heavy laundry and linen loads during a shift. - source_sentence: Trade Associations and Chambers. Executive Branding, Marketing & Communications Director / Assistant Director. The Branding, Marketing & Communications Director/Assistant Director leads the organisations branding and marketing efforts. He/She reviews and endorses the organisations overall marketing, communication and branding strategies, and drives initiatives in adherence to the strategy. He leads the communications with key stakeholders within the organisation and drives cross-functional collaboration in support of achievement of the plan. He is also responsible for leading the development and adoption of new technologies into existing marketing processes and channels.The Branding, Marketing & Communications Director/Assistant Director is highly innovative, creative, strategic and forward-looking. He is encouraging, open to new ideas and strives to improve the organisation's marketing initiatives. He keeps abreast with the latest marketing technologies and serves as a mentor to direct reports, providing guidance on marketing, communication and branding strategies. sentences: - Branding, Marketing & Communications Director / Assistant Director - Monitoring, Surveillance and Testing Executive - Hotel and Accommodation Services. Executive Linen Room Attendant / Laundry Valet Attendant. The Linen Room Attendant/Laundry Valet Attendant performs daily assigned duties to support the day-to-day laundry, linen and uniform room operations, ensuring the delivery of clean garments, uniforms, towels and linens to all internal and external customers. He/She collects and delivers guest laundry, performs laundry cleaning, sorts and issues linens and uniforms, and assists in inventory count. He also cleans and maintains laundry equipment and the work area.As part of service delivery, the Linen Room Attendant/Laundry Valet Attendant has to handle guests' requests and respond to their concerns and feedback in a professional and courteous manner. He complies with organisational guidelines and regulations on hygiene and workplace safety and health, and reports safety hazards observed to ensure workplace safety and security.He is a team player with a high level of attentiveness to details and good communication skills to interact with guests and all levels of staff. He works on shifts, including weekends and public holidays. He is physically fit to meet the physical demands of the job which may involve constant standing, walking and lifting of heavy laundry and linen loads during a shift. - source_sentence: Accountancy. Senior Internal Audit Assistant Consultant. The Internal Audit Assistant Manager is responsible for developing audit procedures and programmes based on internal audit engagement objectives and scope. He/She is involved in supervising internal audit engagements. The Internal Audit Assistant Manager analyses implications of significant changes and infocomm technology (IT) developments to the organisation, business units and key processes. He also guides the team to uphold professional standards and ensure internal audit engagements are executed in accordance with the International Professional Practices Framework (IPPF). He supports the business by applying data analytics and business intelligence tools to analyse data to interpret findings for business insights. The Internal Audit Assistant Manager is scrupulous and accountable. He exercises due professional care in his work. sentences: - Internal Audit Assistant Manager - Director of Sales and Marketing - Sea Transport. Coordinator Sales and Purchase Broker. The Sales and Purchase Broker acts as an intermediary between buyers and sellers of ships and is responsible for overseeing the sale and purchase of ships while ensuring compliance with legal and regulatory requirements. He/She assesses the viability and risks of pursuing new business opportunities and analyses risk management data to highlight potential areas of concern to management. He guides and provides on-the-job coaching to junior colleagues in their daily work. pipeline_tag: sentence-similarity library_name: sentence-transformers metrics: - cosine_accuracy model-index: - name: modernbert-job-role-matcher results: - task: type: triplet name: Triplet dataset: name: Unknown type: unknown metrics: - type: cosine_accuracy value: 1.0 name: Cosine Accuracy --- # modernbert-job-role-matcher This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more. ## Model Details ### Model Description - **Model Type:** Sentence Transformer - **Base model:** [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base) - **Maximum Sequence Length:** 8192 tokens - **Output Dimensionality:** 768 dimensions - **Similarity Function:** Cosine Similarity - **Language:** en - **License:** apache-2.0 ### Model Sources - **Documentation:** [Sentence Transformers Documentation](https://sbert.net) - **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers) - **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers) ### Full Model Architecture ``` SentenceTransformer( (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False}) with Transformer model: ModernBertModel (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True}) (2): Normalize() ) ``` ## Usage ### Direct Usage (Sentence Transformers) First install the Sentence Transformers library: ```bash pip install -U sentence-transformers ``` Then you can load this model and run inference. ```python from sentence_transformers import SentenceTransformer # Download from the 🤗 Hub model = SentenceTransformer("Fatin757/biencoder-v2") # Run inference sentences = [ 'Accountancy. Senior Internal Audit Assistant Consultant. The Internal Audit Assistant Manager is responsible for developing audit procedures and programmes based on internal audit engagement objectives and scope. He/She is involved in supervising internal audit engagements. The Internal Audit Assistant Manager analyses implications of significant changes and infocomm technology (IT) developments to the organisation, business units and key processes. He also guides the team to uphold professional standards and ensure internal audit engagements are executed in accordance with the International Professional Practices Framework (IPPF). He supports the business by applying data analytics and business intelligence tools to analyse data to interpret findings for business insights. The Internal Audit Assistant Manager is scrupulous and accountable. He exercises due professional care in his work.', 'Internal Audit Assistant Manager', 'Sea Transport. Coordinator Sales and Purchase Broker. The Sales and Purchase Broker acts as an intermediary between buyers and sellers of ships and is responsible for overseeing the sale and purchase of ships while ensuring compliance with legal and regulatory requirements. He/She assesses the viability and risks of pursuing new business opportunities and analyses risk management data to highlight potential areas of concern to management. He guides and provides on-the-job coaching to junior colleagues in their daily work.', ] embeddings = model.encode(sentences) print(embeddings.shape) # [3, 768] # Get the similarity scores for the embeddings similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] ``` ## Evaluation ### Metrics #### Triplet * Evaluated with [TripletEvaluator](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.TripletEvaluator) | Metric | Value | |:--------------------|:--------| | **cosine_accuracy** | **1.0** | ## Training Details ### Training Dataset #### Unnamed Dataset * Size: 800 training samples * Columns: anchor, positive, and negative * Approximate statistics based on the first 800 samples: | | anchor | positive | negative | |:--------|:-------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------| | type | string | string | string | | details | | | | * Samples: | anchor | positive | negative | |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | Hotel and Accommodation Services. Senior Director of Sales and Marketing. The Director of Sales and Marketing leads the sales and marketing team in optimising revenue from room sales, catering, events and conference services by attaining sales revenue targets. He/She establishes annual business plans, sales and marketing strategies and key performance indicators for the department and drives revenue management. He directs all sales and marketing activities including market research and partnership management. He also directs resource management, sets service guidelines and standards, and establishes ethical and regulatory parameters, procedures and guidelines for sales and marketing activities to ensure the efficient functioning of the department.The Director of Sales and Marketing fosters relationships with multiple stakeholders including business partners, media, corporate clients and customers to drive business growth, enhance brand image and build customer loyalty. As a head of the... | Director of Sales and Marketing | Logistics. Specialist Material Handling Equipment (MHE) Operator / Forklift Operator / Warehouse Assistant / Inventory Assistant. The Material Handling Equipment (MHE) Operator/Forklift Operator/Warehouse Assistant/Inventory Assistant is responsible for sorting, routing and loading cargo to and from various warehousing or storage locations. Systematic and mechanically-inclined, he/she is also responsible for upholding quality standards, ensuring the safe and efficient operation of material-handling equipment and may also be required to support general warehouse operations. He is expected work with internal and external stakeholders to accomplish his work. | | Workplace Safety and Health. Advisor Senior Workplace Safety and Health Officer. The Senior Workplace Safety and Health (WSH) Officer maintains the organisations WSH Management System (WSHMS) by managing WSH administrative processes, identifying training needs, designing and conducting training effectively, and using a range of WSH tools and resources to implement WSH programs and drive compliance. He/She may be expected to supervise a WSH team and work with internal and external stakeholders to accomplish his work.He is analytical and values teamwork and collaboration in order to solve problems. | Senior Workplace Safety and Health Officer | Arts. Associate Associate / Assistant Sound Designer. Associate/Assistant Sound Designers support the planning and development of music, sound effects and soundscapes to be used during a production, to create the desired impact based on the artistic vision. They support Sound Designers in drafting a sound cue list, which describes the changing sounds throughout the entire production, and assist in the creation of the planned sounds and considerations for positioning of speakers. They need to be comfortable with audio and engine tools, as well as sound technologies, and understand various music styles and genres. | | Arts. Associate Associate / Assistant Sound Designer. Associate/Assistant Sound Designers support the planning and development of music, sound effects and soundscapes to be used during a production, to create the desired impact based on the artistic vision. They support Sound Designers in drafting a sound cue list, which describes the changing sounds throughout the entire production, and assist in the creation of the planned sounds and considerations for positioning of speakers. They need to be comfortable with audio and engine tools, as well as sound technologies, and understand various music styles and genres. | Associate / Assistant Sound Designer | Retail. Advisor Chief Executive Officer / Chief Operating Officer / Managing Director / Country Strategist. The Chief Executive Officer/Chief Operating Officer/Managing Director/Country Manager sets overall direction for the organisation, formulates strategic goals and drives organisational growth. He/she identifies new business opportunities, champions the organisation's service excellence aspirations and fosters strategic relationships with stakeholders. He is also responsible for driving the organisations financial, innovation and productivity strategies.He operates in a rapidly transforming business environment where he is accountable for the success of the entire organisation.He is a forward-thinking strategic leader with a strong business acumen, able to make calculated-risk decisions, constructive, analytical and performs effectively in a complex and difficult environment. | * Loss: [TripletLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#tripletloss) with these parameters: ```json { "distance_metric": "TripletDistanceMetric.EUCLIDEAN", "triplet_margin": 5 } ``` ### Evaluation Dataset #### Unnamed Dataset * Size: 200 evaluation samples * Columns: anchor, positive, and negative * Approximate statistics based on the first 200 samples: | | anchor | positive | negative | |:--------|:------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------| | type | string | string | string | | details | | | | * Samples: | anchor | positive | negative | |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | Workplace Safety and Health. Officer Senior Workplace Safety and Health Officer. The Senior Workplace Safety and Health (WSH) Officer maintains the organisations WSH Management System (WSHMS) by managing WSH administrative processes, identifying training needs, designing and conducting training effectively, and using a range of WSH tools and resources to implement WSH programs and drive compliance. He/She may be expected to supervise a WSH team and work with internal and external stakeholders to accomplish his work.He is analytical and values teamwork and collaboration in order to solve problems. | Senior Workplace Safety and Health Officer | Arts. Executive Associate / Assistant Sound Designer. Associate/Assistant Sound Designers support the planning and development of music, sound effects and soundscapes to be used during a production, to create the desired impact based on the artistic vision. They support Sound Designers in drafting a sound cue list, which describes the changing sounds throughout the entire production, and assist in the creation of the planned sounds and considerations for positioning of speakers. They need to be comfortable with audio and engine tools, as well as sound technologies, and understand various music styles and genres. | | Accountancy. Senior Internal Audit Assistant Coordinator. The Internal Audit Assistant Manager is responsible for developing audit procedures and programmes based on internal audit engagement objectives and scope. He/She is involved in supervising internal audit engagements. The Internal Audit Assistant Manager analyses implications of significant changes and infocomm technology (IT) developments to the organisation, business units and key processes. He also guides the team to uphold professional standards and ensure internal audit engagements are executed in accordance with the International Professional Practices Framework (IPPF). He supports the business by applying data analytics and business intelligence tools to analyse data to interpret findings for business insights. The Internal Audit Assistant Manager is scrupulous and accountable. He exercises due professional care in his work. | Internal Audit Assistant Manager | Sea Transport. Advisor Sales and Purchase Broker. The Sales and Purchase Broker acts as an intermediary between buyers and sellers of ships and is responsible for overseeing the sale and purchase of ships while ensuring compliance with legal and regulatory requirements. He/She assesses the viability and risks of pursuing new business opportunities and analyses risk management data to highlight potential areas of concern to management. He guides and provides on-the-job coaching to junior colleagues in their daily work. | | Hotel and Accommodation Services. Coordinator Director of Sales and Marketing. The Director of Sales and Marketing leads the sales and marketing team in optimising revenue from room sales, catering, events and conference services by attaining sales revenue targets. He/She establishes annual business plans, sales and marketing strategies and key performance indicators for the department and drives revenue management. He directs all sales and marketing activities including market research and partnership management. He also directs resource management, sets service guidelines and standards, and establishes ethical and regulatory parameters, procedures and guidelines for sales and marketing activities to ensure the efficient functioning of the department.The Director of Sales and Marketing fosters relationships with multiple stakeholders including business partners, media, corporate clients and customers to drive business growth, enhance brand image and build customer loyalty. As a head o... | Director of Sales and Marketing | Logistics. Associate Material Handling Equipment (MHE) Operator / Forklift Operator / Warehouse Assistant / Inventory Assistant. The Material Handling Equipment (MHE) Operator/Forklift Operator/Warehouse Assistant/Inventory Assistant is responsible for sorting, routing and loading cargo to and from various warehousing or storage locations. Systematic and mechanically-inclined, he/she is also responsible for upholding quality standards, ensuring the safe and efficient operation of material-handling equipment and may also be required to support general warehouse operations. He is expected work with internal and external stakeholders to accomplish his work. | * Loss: [TripletLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#tripletloss) with these parameters: ```json { "distance_metric": "TripletDistanceMetric.EUCLIDEAN", "triplet_margin": 5 } ``` ### Training Hyperparameters #### Non-Default Hyperparameters - `eval_strategy`: epoch - `per_device_train_batch_size`: 4 - `per_device_eval_batch_size`: 4 - `gradient_accumulation_steps`: 4 - `learning_rate`: 2e-05 - `lr_scheduler_type`: cosine - `warmup_ratio`: 0.1 - `load_best_model_at_end`: True - `batch_sampler`: no_duplicates #### All Hyperparameters
Click to expand - `overwrite_output_dir`: False - `do_predict`: False - `eval_strategy`: epoch - `prediction_loss_only`: True - `per_device_train_batch_size`: 4 - `per_device_eval_batch_size`: 4 - `per_gpu_train_batch_size`: None - `per_gpu_eval_batch_size`: None - `gradient_accumulation_steps`: 4 - `eval_accumulation_steps`: None - `torch_empty_cache_steps`: None - `learning_rate`: 2e-05 - `weight_decay`: 0.0 - `adam_beta1`: 0.9 - `adam_beta2`: 0.999 - `adam_epsilon`: 1e-08 - `max_grad_norm`: 1.0 - `num_train_epochs`: 3 - `max_steps`: -1 - `lr_scheduler_type`: cosine - `lr_scheduler_kwargs`: {} - `warmup_ratio`: 0.1 - `warmup_steps`: 0 - `log_level`: passive - `log_level_replica`: warning - `log_on_each_node`: True - `logging_nan_inf_filter`: True - `save_safetensors`: True - `save_on_each_node`: False - `save_only_model`: False - `restore_callback_states_from_checkpoint`: False - `no_cuda`: False - `use_cpu`: False - `use_mps_device`: False - `seed`: 42 - `data_seed`: None - `jit_mode_eval`: False - `use_ipex`: False - `bf16`: False - `fp16`: False - `fp16_opt_level`: O1 - `half_precision_backend`: auto - `bf16_full_eval`: False - `fp16_full_eval`: False - `tf32`: None - `local_rank`: 0 - `ddp_backend`: None - `tpu_num_cores`: None - `tpu_metrics_debug`: False - `debug`: [] - `dataloader_drop_last`: False - `dataloader_num_workers`: 0 - `dataloader_prefetch_factor`: None - `past_index`: -1 - `disable_tqdm`: False - `remove_unused_columns`: True - `label_names`: None - `load_best_model_at_end`: True - `ignore_data_skip`: False - `fsdp`: [] - `fsdp_min_num_params`: 0 - `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False} - `fsdp_transformer_layer_cls_to_wrap`: None - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None} - `deepspeed`: None - `label_smoothing_factor`: 0.0 - `optim`: adamw_torch - `optim_args`: None - `adafactor`: False - `group_by_length`: False - `length_column_name`: length - `ddp_find_unused_parameters`: None - `ddp_bucket_cap_mb`: None - `ddp_broadcast_buffers`: False - `dataloader_pin_memory`: True - `dataloader_persistent_workers`: False - `skip_memory_metrics`: True - `use_legacy_prediction_loop`: False - `push_to_hub`: False - `resume_from_checkpoint`: None - `hub_model_id`: None - `hub_strategy`: every_save - `hub_private_repo`: None - `hub_always_push`: False - `gradient_checkpointing`: False - `gradient_checkpointing_kwargs`: None - `include_inputs_for_metrics`: False - `include_for_metrics`: [] - `eval_do_concat_batches`: True - `fp16_backend`: auto - `push_to_hub_model_id`: None - `push_to_hub_organization`: None - `mp_parameters`: - `auto_find_batch_size`: False - `full_determinism`: False - `torchdynamo`: None - `ray_scope`: last - `ddp_timeout`: 1800 - `torch_compile`: False - `torch_compile_backend`: None - `torch_compile_mode`: None - `include_tokens_per_second`: False - `include_num_input_tokens_seen`: False - `neftune_noise_alpha`: None - `optim_target_modules`: None - `batch_eval_metrics`: False - `eval_on_start`: False - `use_liger_kernel`: False - `eval_use_gather_object`: False - `average_tokens_across_devices`: False - `prompts`: None - `batch_sampler`: no_duplicates - `multi_dataset_batch_sampler`: proportional
### Training Logs | Epoch | Step | Training Loss | Validation Loss | cosine_accuracy | |:-------:|:-------:|:-------------:|:---------------:|:---------------:| | 1.0 | 50 | - | 3.5529 | 1.0 | | 2.0 | 100 | 14.8274 | 3.2619 | 1.0 | | **3.0** | **150** | **-** | **3.2237** | **1.0** | * The bold row denotes the saved checkpoint. ### Framework Versions - Python: 3.11.13 - Sentence Transformers: 4.1.0 - Transformers: 4.52.4 - PyTorch: 2.6.0+cu124 - Accelerate: 1.7.0 - Datasets: 2.14.4 - Tokenizers: 0.21.1 ## Citation ### BibTeX #### Sentence Transformers ```bibtex @inproceedings{reimers-2019-sentence-bert, title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks", author = "Reimers, Nils and Gurevych, Iryna", booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing", month = "11", year = "2019", publisher = "Association for Computational Linguistics", url = "https://arxiv.org/abs/1908.10084", } ``` #### TripletLoss ```bibtex @misc{hermans2017defense, title={In Defense of the Triplet Loss for Person Re-Identification}, author={Alexander Hermans and Lucas Beyer and Bastian Leibe}, year={2017}, eprint={1703.07737}, archivePrefix={arXiv}, primaryClass={cs.CV} } ```