SentenceTransformer based on sentence-transformers/paraphrase-mpnet-base-v2
This is a sentence-transformers model finetuned from sentence-transformers/paraphrase-mpnet-base-v2. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
Model Details
Model Description
- Model Type: Sentence Transformer
- Base model: sentence-transformers/paraphrase-mpnet-base-v2
- Maximum Sequence Length: 512 tokens
- Output Dimensionality: 768 dimensions
- Similarity Function: Cosine Similarity
Model Sources
- Documentation: Sentence Transformers Documentation
- Repository: Sentence Transformers on GitHub
- Hugging Face: Sentence Transformers on Hugging Face
Full Model Architecture
SentenceTransformer(
(0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: MPNetModel
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)
Usage
Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
"Professional BackgroundCertified Coding Specialists (CCS) with E/M, outpatient, in patient/ER admits, diagnostic, procedural /pro fee Coding, CMS-DRG, VBP, CPT II codes, HEDIS, HCC, RAF, data analyst and quality auditing in health management programs, ICD 10 Certified. \xa05 Years experience in Administration/ Office management and as Coding/billing manager. Licensed EMT-I since 2002. 10+ years' experience in billing and 6 years coding experience, 3rd Party insurance follow up which include commercial, work comp, VA, Medicare, Medicaid, appeals, insurance verification, authorizations. 5+ years Clinical as a Medical Assistant, phone triage, in office surgical procedures. I have a total of 18 years working in the medical field and VERY customer service oriented. Knowledgeable with various different EMR, EHR systems, Cerner, Centricity, Athena, Allmeds to name a few. Excel, Word, Outlook,Salesforce. I have two secret Government clearances given 1985 still active thru the Department of Defense so all my background checks run smoothly and pass with flying colors.\nSkill HighlightsCCSAttestationsSDSHEDIS/Quality measuresHCCCMS-DRGOut patinetSkilled nursingHome healthRAFVBPCPT II codesICD- 10EPRGSales forceWordExcelOutlook10 Key by touch62 WMP typingEpicPulseencoderCernerAllmedsEMR/EHR\nEducation and TrainingEdison Community college,Expected in2002––Allied Health Business college ICD 10, Certified Coding Specialists\nCurrent: NAHP, AHIMA & AAPC memberships.:Emergency Medical Services-GPA:Emergency Medical Services\nProfessional ExperienceAltium-CMS / HHCS/ HEDIS/Coding/ data analyst and quality coordinatorLa Jolla,CA,06/2016-CurrentReview, obtain data extracted remotely and on site physician medical records to analyze quality and outcome of health management programs, quality, pharmacy, Financial, claims, coding, helping to locate where providers need to close gaps, information missing to maintain highest ratings and help with SDS/attestation submission. Knowledgeable with many different EMR systems, HHCS, RAF, HEDIS, CMS DRG CPT II, Coding guidelines. Our goal is to see that the physician receives any and all monies available to them and to help them provide the best possible healthcare to our members. We provide training to the offices where they may need help in closing these gapsDr MT Pally MD Cardiologist-Coder/Billing ManagerCity,STATE,04/2015-2016Performed daily charge entry, review and obtained codes using MS-DRG, VBP, HCC, RAF, HEDIS quality auditing/guidelines, Coding for all office visit, inpatient hospital visits, tests, ER admits, Echo's/Vascular, Nuclear stress Testing, PET Scan and all nursing home, home health visits. Query physician and tech for any missing or incomplete documentation, maintaining a high productivity standard with 95%+ accuracy, working denials, letters of appeals. Assisting the front desk whenever needed, answering phones, scheduling appointments, verifying insurance's, obtaining authorizations. \xa0Ali XXX XXX 9550Tenet Health Catawba Cariothoracic Surgeons-Coder/Front Office Coordinator/coderCity,STATE,08/2014-03/2015Check in/check out, scheduling, phone triage, insurance verification, insurance authorizations, Medical assisting, room patients, obtain vitals, chart documentation, Reviewed and code entry using MS-DRG, VBP, HCC, RAF, HEDIS quality/guidelines, answering high volume calls, data entry in Nex Gen *EMR, managing medical records, surgical boarding, collecting copays, deposits and provide quality customer service.800 367 2884 Ann Marie.HMA/Physicans Regional Hosptial-Coder/Insurance verification specialistsCity,STATE,07/2013-08/2014Reviewed and corrected Coding using the MS-DRG, VBP, HEDIS quality auditing/ guidelines for all the high cost surgical procedures, verified and authorized insurance, quote patient pricing, answer any patient questions regarding insurance, pricing or procedure, data entry in EMR system, team player and provide excellent customer service. Stacy 704-660-4584.Centura Health Systems-Coder/Patient Account RepresentativeCity,STATE,07/2010-01/2013Answered high volume patient's questions, insurance verification, data entry in Meditech, work insurance collections, 3rd party follow up, query physicians and tech for missing or clarification of documentation, corrected coding issues, performed paper and electronic billing, correct ICD-9 CPT coding using MS-DRG, VBP, HCC, RAF, HEDIS quality auditing/guidelines for accounts receivables, and provide excellent customer service.Was a rehire Tawyna Scott XXX-715 7000.The Swedish Hospital-Medical Assistant/EMT at Hand Surgery Associates atCity,STATE,09/2009-05/2010Triage and room patients, provided assessment of injury/wounds, removed sutures, dressings, applied casts and splints, assisted with surgical procedures, and performed data entry in EMR and provide excellent customer service.Kim Beard XXX 744 7078.Associates Of Otolaryngology-Medical Assistant/EMT at Associates of OtolaryngologyCity,STATE,04/2008-06/2009High volume phone triage, greet and room patients, obtained vitals, performed data entry in EMR system, in room scribe, assisted with office surgical procedures, ICD-9, CPT coding, transcription, injections, biopsies, cultures, lab and radiology orders, Team player and performed excellent customer service.Diana Mcleron XXX 744 1961Press O Matic Keyless Locks-Office ManagerCity,STATE,2005-2008Manage front office, answered phones, assist with phone sales and walk in sales, invoicing, shipping and receiving, A/R, A/P, quick books, handled monthly inventory, ordering, restocking, some assembly of production line when needed, faxed, filed, copier, 10 key by touch, 62 WPM typing, some soft collections. Outlook, Excel, Word. \xa0Dave Campbell \xa0XXX 762 7373.Lee Health-Out patient registration/Central SchedulingCity,STATE,10/2001-01/2005Handled large volume of patient calls scheduling patients for all out patient testing, obtaining correct dr orders with correct coding. \xa0Obtained and data entry correct patient demographics insurance information at time of out patient testing, verified insurance information, collected co payments, assisted patients to areas of testing. \xa0provide excellent customer service.21st Century Oncology-Biller/customer service/payment posterCity,STATE,10/1998-10/2001Posted large insurance checks and patient payments to correct DOS in accounts, balance daily, answered patient questions regarding billing/accounts, worked 3rd party denials, timely filing, letters of appeals for Medicare, Medicaid, VA, work comp, commercial insurances, corrected coding errors. worked with patients on payment agreements and soft collections, met daily productivity goals, provided excellent customer service.\nSkills10 key by touch, accounts receivables, RAF, Anatomy, AP, scheduling appointments, AR, auditing, billing, Bookkeeping, Call center, Cardiologist, closing, CMS, CPT II, CPT coding, CPT, excellent customer service, customer service, data analyst, data analysis, data entry, documentation, faxing, filing, Financial, Front Office, home health, ICD 10, ICD-9, injections, Insurance, inventory, invoicing, letters, Director, managing 5, managing, Medical assisting, Medical Manager, Medical Terminology, Meditech, meetings, Excel, Office, Outlook, Word, Nursing, nursing home, ordering office supplies, outside sales, payment processing, pharmacology, Physiology, pricing, processes, Coding, Quality, quick, Quickbooks, radiology, sales, Scheduling, shipping, spread sheet, Supervisor, Surgery, Team player, answering phones, phones, phone, transcription, Triage, phone triage, typing, wound care.",
'Infomatics is an Inc 5005000 corporation for the last 7 years in a row. We have an urgent need for a Business Analyst in Pontiac, MI. Please find the job details below. \nTitle: Business AnalystLocation: Pontiac, MIDuration: Long Term Contract \nDescription: Client is seeking an experienced business analyst to join the Application Services team working in a hybrid work environment. We are seeking a hands-on, self-starter, critical thinking team player possessing both general technical knowledge and interpersonal skills. Experienced in implementing process re-engineering, developing business requirements, use cases and test scripts using industry accepted practices. Should possess high level understanding of information technology concepts as well as the SDLC methodology. Must be flexible and able to multi-task, working on multiple projects and internal initiatives, inclusive of upgrades, maintenance, and enhancements. Under supervision, conducts business process analyses and needs assessments to align information technology solutions with the business initiatives. Supports analytical functions by assisting programmers in ascertaining user needs and adapting user procedures to final program design. Organizes and facilitates application testing and user acceptance to ensure business communitys needs are met. Acts as second and third level support for Production incidents and facilitates troubleshooting and close out of reported issues for multiple applications. Utilizes current county-wide andor department specific software to complete assignments.\nExperience Level: 4+ years\nStart Date: 09182023.Duration: 2+ years\nEnvironment: Azure DevOps, MS Visio, MS Office Suite\n\nIf you have the above skillsexperience, please share your resume in confidence to:\nRecruiter Name: Sravan KumarEmail: sravan@infomatinc.com\nEOE',
'Solstice Consulting Group is seeking a Senior Software Engineer (C++) for an energy related client in the South Houston Area. Base $110k - $135k DOE, 15% bonus opportunity and excellent benefitsCANDIDATES MUST BE US CITIZEN OR GREEN CARD ONLYMinimum of 5+ years of recent C++ experience required Produce, debug, and implement functional software solutions and work with management to define software requirements. Execute full software development life cycle (SDLC). Work with internal field service teams to identify and solve issues related to software systems and help collect needed software improvements. MAIN TASKS Develop high-quality software design and architectureIdentify, prioritize, and execute tasks in the software development life cycleAutomate tasks through appropriate tools and scriptingReview and debug codePerform validation and verification testingCollaborate with internal users to improve productsClearly document project requirements, develop project proposals, assist in developing use manuals and any other technical informationAbility to work on multiple projects at the same time QUALIFICATIONS: Bachelors Degree in Computer Science or equivalent experience in related field.7+ years of experience in a similar role with designing, programming, debugging, testing, and supporting multiple product lines.5+ years experience with selected programming languages (C++)Experience with Python, JavaScript, PHP preferredIn-depth knowledge of PostgreSQL or other relational databasesFamiliarity with the Linux operating systemFamiliarity with version control system (GitBitbucket)Analytical mind with problem-solving aptitudeAbility to work independently and as part of an integrated teamExcellent organizational skills',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
Training Details
Training Dataset
Unnamed Dataset
- Size: 6,241 training samples
- Columns:
sentence_0
,sentence_1
, andlabel
- Approximate statistics based on the first 1000 samples:
sentence_0 sentence_1 label type string string float details - min: 321 tokens
- mean: 506.75 tokens
- max: 512 tokens
- min: 16 tokens
- mean: 384.91 tokens
- max: 512 tokens
- min: 0.0
- mean: 0.36
- max: 1.0
- Samples:
sentence_0 sentence_1 label Career OverviewSoftware developer adept at application development, testing and optimization. Excels at dot net application development, including coordinating ground-up planning, programming and implementation for core modules.
QualificationsOperating Systems: Windows 95/98/2000/xp/2003/7 Programming Languages: C#, ASP.Net, ASP, VB.NET, C Dot Net Technologies: Net Framework 4.5/4/3.5/3.0/2.0/1.1, ASP.NET, VB.NET, ADO.NET, Ajax Web Technologies: HTML, DHTML, CSS, XML Web Server: IIS (Internet Information Server) Databases: Microsoft SQL Server 2000/2005/2008/2010/2012, MS Access, PL/SQL MS Framework: NET Framework 4.5/4.0/3.5/3.0/2.0 Designing Tools: Visual Studio.NET (2003/2005/2008/2010/2012), MS Front Page, Graphic design, Adobe Dreamweaver, Adobe Flash, Adobe Photoshop and Coral Draw Scripting Language: VB Script, Java Script Reporting: MS SQL Reporting Services (SSRS), Crystal Reports
Work Experience08/2013toCurrentSoftware DeveloperHp Inc–Olympia,WA,It is 24/7 home shopping and e...A Senior Software Engineer at O'Reilly Auto Parts develops and supports applications for internal and external systems including Inventory, Supply Chain, eCommerce, Retail Applications, Enterprise Search and more. Our teams are focused on the development, design and integration of various software systems, databases, and third-party packages utilizing tools and technologies including Java, JavaScript, Spring, Hibernate, and SQL. This particular position will be a full stack role working on Warehouse Management Applications; however, we will consider anyone with Supply Chain Application Development experience.
The base salary for this position is $116,000-$145,000 annually plus a 10% Annual Bonus. Exact compensation will be determined based on experience, however mid point around $126,000 - $131,000 would be more practical.
What You'll Do:Partner with key stakeholders to develop new features and enhance and support existing applications and programs.Work with business systems analysts a...1.0
SummaryProfessional accountant with an outstanding work ethic and integrity seeking to make a valuable contribution utilizing strong analytical, organizational, communication, and computer skills. Summa Cum Laude graduate with BBA in Accounting
*Eight years of accounting experience
*Three years of public accounting experience in governmental auditing
*Five years of private industry accounting and tax experience
*Experience utilizing Microsoft Office, Microsoft Dynamics AX, CaseWare, Ohio Auditor of State GAAP Reporting System, OneSource, SBT, SysPro, and Crystal Reports
*Ohio Notary Public (Commission expires February 15, 2021)
SkillsAnalytical reasoningCompliance testing knowledgeEffective time managementPublic and private accountingStrong organizational skillsGeneral ledger accountingSuperior research skillsFlexible team player
Education and TrainingKent State UniversityKent,OhioExpected in––Bachelor of Business Administration:Accounting-GPA:Accounting Graduated Summa Cum Laude 3.84 ...Position Title: Senior Accountant Organization: Jewish Family Service of San Diego Department: Family and Community Services Division Organization: Jewish Family Service of San Diego Position Type: Full-Time (37.5+ hoursweek), Exempt Salary: $82,000 - $88,000year Total Compensation: In addition to standard pay, compensation for this position includes: Comprehensive, low-cost healthcare coverage for employees Generous employer 401(k) contributions Employer-covered life insurance Time Away from Work: Being able to take time away from work is critical in bringing your best self to work. Time off benefits for this position include: Generous paid vacation time and sick leave 17 paid holidays, including Federal, Jewish, and floating holidays 2 Wellness Days to be taken any time during the year to support employees mental wellness Position Overview:The Senior Accountant is an integral part of the financial planning function within the Finance & Accounting Team. The position works closely with...
0.5
Professional SummaryHighly motivated Sales Associate with extensive customer service and sales experience. Outgoing sales professional with track record of driving increased sales, improving buying experience and elevating company profile with target market.
SkillsQuickBooks, CCH ATX, Microsoft Office Suiteaccount reconciliation, accounting, administrative, bookkeeping, C, CA, consulting, contracts, credit, client, clients, documentation, filing, financial analysis, forms, funds, general ledger, MA, Mandarin, marketing, Excel, Microsoft Office Suite, payroll, QuickBooks, real estate, reporting, sales, tax compliance, tax, taxes, tax returns, telemarketing, venture capital
Work History01/2016toCurrentTax AccountantE. & J. Gallo WineryHouston,TX,Prepared and reviewed hundreds of federal and multi-state tax returns for Individuals, Partnerships, LLCs, S
Corporations, and C Corporations (1040/1040NR/1120/1120S/1065, AZ/ CA/ DE/ FL/ IL/ MA/ MN / NY/ WI state
filing)
Conducted con...Position: Junior AccountantDepartment: Finance & AdministrationReports to: ControllerFLSA Status: Exempt
JOB SUMMARYThe Junior Accountant will perform accounting duties related to the efficient maintenance and processing of accounts payable transactions. She will review and analyze expense reports, work with vendors to resolve invoices, and reconcile monthly vendor statements. The Junior Accountant will administer the corporate card account activities and reconcile monthly statements.
MEASURE(S) OF SUCCESS Accuracy while managing a high volume of invoice and journal entry transactions. Time required to complete assigned tasks for month-end close. Meeting all deadlines for escheatment filings. Resolve outstanding checks by collaborating with the billing team.
COMPETENCIESAdaptability - Employee is open to new ideas and ways of doing business and adopts change willingly.Communication - Employee expresses thoughts and ideas in a clear and effective manner. Employee communicates directly a... - Loss:
CosineSimilarityLoss
with these parameters:{ "loss_fct": "torch.nn.modules.loss.MSELoss" }
Training Hyperparameters
Non-Default Hyperparameters
per_device_train_batch_size
: 16per_device_eval_batch_size
: 16multi_dataset_batch_sampler
: round_robin
All Hyperparameters
Click to expand
overwrite_output_dir
: Falsedo_predict
: Falseeval_strategy
: noprediction_loss_only
: Trueper_device_train_batch_size
: 16per_device_eval_batch_size
: 16per_gpu_train_batch_size
: Noneper_gpu_eval_batch_size
: Nonegradient_accumulation_steps
: 1eval_accumulation_steps
: Nonetorch_empty_cache_steps
: Nonelearning_rate
: 5e-05weight_decay
: 0.0adam_beta1
: 0.9adam_beta2
: 0.999adam_epsilon
: 1e-08max_grad_norm
: 1num_train_epochs
: 3max_steps
: -1lr_scheduler_type
: linearlr_scheduler_kwargs
: {}warmup_ratio
: 0.0warmup_steps
: 0log_level
: passivelog_level_replica
: warninglog_on_each_node
: Truelogging_nan_inf_filter
: Truesave_safetensors
: Truesave_on_each_node
: Falsesave_only_model
: Falserestore_callback_states_from_checkpoint
: Falseno_cuda
: Falseuse_cpu
: Falseuse_mps_device
: Falseseed
: 42data_seed
: Nonejit_mode_eval
: Falseuse_ipex
: Falsebf16
: Falsefp16
: Falsefp16_opt_level
: O1half_precision_backend
: autobf16_full_eval
: Falsefp16_full_eval
: Falsetf32
: Nonelocal_rank
: 0ddp_backend
: Nonetpu_num_cores
: Nonetpu_metrics_debug
: Falsedebug
: []dataloader_drop_last
: Falsedataloader_num_workers
: 0dataloader_prefetch_factor
: Nonepast_index
: -1disable_tqdm
: Falseremove_unused_columns
: Truelabel_names
: Noneload_best_model_at_end
: Falseignore_data_skip
: Falsefsdp
: []fsdp_min_num_params
: 0fsdp_config
: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}tp_size
: 0fsdp_transformer_layer_cls_to_wrap
: Noneaccelerator_config
: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}deepspeed
: Nonelabel_smoothing_factor
: 0.0optim
: adamw_torchoptim_args
: Noneadafactor
: Falsegroup_by_length
: Falselength_column_name
: lengthddp_find_unused_parameters
: Noneddp_bucket_cap_mb
: Noneddp_broadcast_buffers
: Falsedataloader_pin_memory
: Truedataloader_persistent_workers
: Falseskip_memory_metrics
: Trueuse_legacy_prediction_loop
: Falsepush_to_hub
: Falseresume_from_checkpoint
: Nonehub_model_id
: Nonehub_strategy
: every_savehub_private_repo
: Nonehub_always_push
: Falsegradient_checkpointing
: Falsegradient_checkpointing_kwargs
: Noneinclude_inputs_for_metrics
: Falseinclude_for_metrics
: []eval_do_concat_batches
: Truefp16_backend
: autopush_to_hub_model_id
: Nonepush_to_hub_organization
: Nonemp_parameters
:auto_find_batch_size
: Falsefull_determinism
: Falsetorchdynamo
: Noneray_scope
: lastddp_timeout
: 1800torch_compile
: Falsetorch_compile_backend
: Nonetorch_compile_mode
: Noneinclude_tokens_per_second
: Falseinclude_num_input_tokens_seen
: Falseneftune_noise_alpha
: Noneoptim_target_modules
: Nonebatch_eval_metrics
: Falseeval_on_start
: Falseuse_liger_kernel
: Falseeval_use_gather_object
: Falseaverage_tokens_across_devices
: Falseprompts
: Nonebatch_sampler
: batch_samplermulti_dataset_batch_sampler
: round_robin
Training Logs
Epoch | Step | Training Loss |
---|---|---|
1.2788 | 500 | 0.1164 |
2.5575 | 1000 | 0.0739 |
Framework Versions
- Python: 3.11.12
- Sentence Transformers: 3.4.1
- Transformers: 4.51.3
- PyTorch: 2.6.0+cu124
- Accelerate: 1.5.2
- Datasets: 3.5.0
- Tokenizers: 0.21.1
Citation
BibTeX
Sentence Transformers
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
- Downloads last month
- 65
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support