I will fine tune llms with lora, qlora and hugging face
Automation and AI Engineer
Over deze dienst
Need an LLM that understands your domain, terminology, writing style, task, or proprietary dataset better than the base model?
I will fine-tune an open-source Large Language Model using modern parameter-efficient techniques such as LoRA and QLoRA, using the Hugging Face ecosystem.
Rather than simply running a training script, I focus on the complete fine-tuning workflow:
Dataset -> Training -> Evaluation -> Inference -> Deployment
I can help you with:
- LLM fine-tuning using LoRA and QLoRA
- Hugging Face Transformers and PEFT
- Dataset preparation and chat/instruction formatting
- Supervised fine-tuning (SFT)
- Domain-specific model adaptation
- Model evaluation and base-model comparison
- Quantization and efficient inference
- Training and inference scripts
- FastAPI inference APIs
- Docker-based deployment
- Integration of the resulting model into your application
I can work with suitable open-source models from the Hugging Face ecosystem, including Llama-family, Qwen, Mistral, Gemma, and similar transformer-based language models.
Klanten waar ik mee heb gewerkt
Fortinet
Cybersecurity
I worked with Sken.ai, now acquired by Fortinet, on a short-term project, conducting machine learning experiments on proprietary data. Using AWS, I focused on finding patterns, clustering, and classification within textual data.
apr 2021-apr 2021
Mijn portfolio
Andere Data science en ML diensten die ik aanbied
Veelgestelde vragen
What is LoRA?
LoRA is a parameter-efficient fine-tuning technique that adapts a large language model by training a relatively small number of additional parameters instead of updating the entire model. This significantly reduces GPU memory and training requirements.
What is QLoRA?
QLoRA combines quantization with LoRA so large models can be fine-tuned using substantially less GPU memory while retaining much of their original capability. It is especially useful when compute resources are limited.
Can you fine-tune any Hugging Face model?
I can work with many transformer-based models that support practical fine-tuning through the Hugging Face ecosystem. Please send me the exact model or your requirements before ordering because hardware, architecture, licensing, and dataset size can affect feasibility.
Can you fine-tune Llama, Qwen, Mistral or Gemma models?
Yes, where the selected model, hardware, licensing, and project requirements allow it. I will recommend the model size and fine-tuning strategy based on your task and available compute.
Do I need a dataset?
Yes. Fine-tuning requires suitable training data. If your dataset needs light restructuring or formatting, that can be included depending on the package.
How much data do I need?
It depends on the task and quality of the examples. A small, high-quality dataset can sometimes outperform a much larger noisy dataset. I will evaluate the dataset before training and recommend whether it is suitable.
Can you guarantee the fine-tuned model will be better?
No responsible AI engineer should guarantee that before testing. Performance depends on the base model, dataset quality, dataset size, training configuration, evaluation method, and target task. That is why evaluation is included in my workflow.
Should I use RAG or fine-tuning?
They solve different problems. RAG is usually appropriate when the model needs access to changing or private knowledge. Fine-tuning is useful when you want to change model behavior, domain adaptation, style, terminology, output format, or task performance. Some systems benefit from both.
Can you deploy the fine-tuned model?
Yes. The Premium package can include an inference API, Docker configuration, deployment documentation, and integration guidance. Cloud infrastructure and GPU hosting costs are separate.
Who pays for GPU/cloud training?
Any significant third-party GPU, API, storage, or hosting costs are paid by the client unless explicitly included in the custom offer. I will discuss expected compute requirements before training.
2 reviews van deze dienst
| (2) | ||
| (0) | ||
| (0) | ||
| (0) | ||
| (0) |
Specificering van de beoordeling
- Communicatieniveau van de freelancer
- Kwaliteit van de levering
- Waarde van de levering
Sorteer op
J jo1hnj

Verenigde Staten
Lopende samenwerkingSuggested a creative solution to the problem. Delivery time was great. Clear documentation so the results are reproducible.
US$ 100-US$ 200
Prijs
4 dagen
Looptijd
Nuttig?K kr1s_ra

Oostenrijk
Pleasure doing business. Very fast delivery.
US$ 50
Prijs
3 dagen
Looptijd
Nuttig?
2 reviews van deze dienst
| (2) | ||
| (0) | ||
| (0) | ||
| (0) | ||
| (0) |
Specificering van de beoordeling
- Communicatieniveau van de freelancer
- Kwaliteit van de levering
- Waarde van de levering
Sorteer op
J jo1hnj

Verenigde Staten
Lopende samenwerkingSuggested a creative solution to the problem. Delivery time was great. Clear documentation so the results are reproducible.
US$ 100-US$ 200
Prijs
4 dagen
Looptijd
Nuttig?K kr1s_ra

Oostenrijk
Pleasure doing business. Very fast delivery.
US$ 50
Prijs
3 dagen
Looptijd
Nuttig?

