Generative AI: 1. Ethics 2.CLIP: Difference between revisions
Jump to navigation
Jump to search
| Line 37: | Line 37: | ||
Red teaming dataset exploration. <br> | Red teaming dataset exploration. <br> | ||
Reading about ethical theories. <br> | Reading about ethical theories. <br> | ||
| | | | ||
|- | |- | ||
| Line 48: | Line 46: | ||
| | | | ||
|- | |- | ||
| Line 58: | Line 54: | ||
ETHICS dataset formatting for Llama fine-tuning and evaluation. | ETHICS dataset formatting for Llama fine-tuning and evaluation. | ||
Llama supervised model fine-tuning | Llama supervised model fine-tuning | ||
|- | |- | ||
| Line 65: | Line 59: | ||
!scope="row"|Week 10 | !scope="row"|Week 10 | ||
| | | | ||
Evaluation of Llama model before and after fine-tuning with ETHICS dataset. | Evaluation of Llama model before and after fine-tuning with ETHICS dataset. | ||
| | | | ||
| Line 85: | Line 77: | ||
!scope="row"|Week 12 | !scope="row"|Week 12 | ||
| | | | ||
| | | | ||
| Line 93: | Line 83: | ||
!scope="row"|Week 13 | !scope="row"|Week 13 | ||
| | | | ||
| | | | ||
| Line 101: | Line 89: | ||
!scope="row"|Week 14 | !scope="row"|Week 14 | ||
| | | | ||
| Write the Wikipedia page & Final presentation | | Write the Wikipedia page & Final presentation | ||
Revision as of 21:33, 4 December 2023
Project Plan and Milestones
Weekly Plan
| Date | Task | Completion | ||
|---|---|---|---|---|
| Week 4 |
Paper reading. | |||
| Week 5 |
Familiarizing with Dromedary, SALMON, Llama base models. | |||
| Week 6 |
Evaluation of different base models. |
|||
| Week 7 |
Red teaming dataset exploration. |
|||
| Week 8 |
ETHICS dataset discovering. |
|||
| Week 9 |
ETHICS dataset formatting for Llama fine-tuning and evaluation. Llama supervised model fine-tuning | |||
| Week 10 |
Evaluation of Llama model before and after fine-tuning with ETHICS dataset. |
Mid-term Presentation & Start writing the Wikipedia page with the plan. | ||
| Week 11 |
Read about Reinforcement learning using PPO. |
Re-formatting deontology dataset. |
||
| Week 12 | ||||
| Week 13 | ||||
| Week 14 | Write the Wikipedia page & Final presentation |
Milestone 1
- Choose the project subject.
- Read papers about the existing studies in this field.
- Define our research questions.
Milestone 2
- Refine our research questions.
- Explore different ethical theories.
- Find an appropriate dataset.
- Evaluate our fine-tuned supervised model.
Milestone 3
- Get our Preference and the Reinforcement learning models.
- Analyze the results.
- Write the Wikipedia page.