Ponder.cat
  • Communities
  • heart
  • search
    • Login
    • Sign Up
    • Communities

    • heart
      Support Lemmy
    • search
      Search

    • Login
    • Sign Up
    Cat to Technology@lemmy.worldEnglish · 4 months ago

    The dark deep side of DeepSeek: Fine-tuning attacks against the safety alignment of CoT-enabled models.

    arxiv.org

    external-link
    message-square
    2
    fedilink
    • cross-posted to:
    • technology@lemmy.zip
    27
    external-link

    The dark deep side of DeepSeek: Fine-tuning attacks against the safety alignment of CoT-enabled models.

    arxiv.org

    Cat to Technology@lemmy.worldEnglish · 4 months ago
    message-square
    2
    fedilink
    • cross-posted to:
    • technology@lemmy.zip
    The dark deep side of DeepSeek: Fine-tuning attacks against the safety alignment of CoT-enabled models
    arxiv.org
    external-link
    Large language models are typically trained on vast amounts of data during the pre-training phase, which may include some potentially harmful information. Fine-tuning attacks can exploit this by prompting the model to reveal such behaviours, leading to the generation of harmful content. In this paper, we focus on investigating the performance of the Chain of Thought based reasoning model, DeepSeek, when subjected to fine-tuning attacks. Specifically, we explore how fine-tuning manipulates the model's output, exacerbating the harmfulness of its responses while examining the interaction between the Chain of Thought reasoning and adversarial inputs. Through this study, we aim to shed light on the vulnerability of Chain of Thought enabled models to fine-tuning attacks and the implications for their safety and ethical deployment.
    alert-triangle
    You must log in or register to comment.
    • 🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖@lemm.ee
      link
      fedilink
      English
      arrow-up
      6
      ·
      4 months ago

      I love how a failure to censor is now a safety issue.

      • Corkyskog@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        4
        ·
        4 months ago

        Seriously. They act like it was trained on classified information or something

    Technology@lemmy.world

    technology@lemmy.world

    Subscribe from Remote Instance

    Create a post
    You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmy.world

    This is a most excellent place for technology news and articles.


    Our Rules


    1. Follow the lemmy.world rules.
    2. Only tech related news or articles.
    3. Be excellent to each other!
    4. Mod approved content bots can post up to 10 articles per day.
    5. Threads asking for personal tech support may be deleted.
    6. Politics threads may be removed.
    7. No memes allowed as posts, OK to post as comments.
    8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
    9. Check for duplicates before posting, duplicates may be removed
    10. Accounts 7 days and younger will have their posts automatically removed.

    Approved Bots


    • @L4s@lemmy.world
    • @autotldr@lemmings.world
    • @PipedLinkBot@feddit.rocks
    • @wikibot@lemmy.world
    Visibility: Public
    globe

    This community can be federated to other instances and be posted/commented in by their users.

    • 3.38K users / day
    • 9.22K users / week
    • 16.7K users / month
    • 37.4K users / 6 months
    • 4 local subscribers
    • 70.5K subscribers
    • 6.77K Posts
    • 183K Comments
    • Modlog
    • mods:
    • L3s@lemmy.world
    • enu@lemmy.world
    • Technopagan@lemmy.world
    • L4sBot@lemmy.world
    • L3s@hackingne.ws
    • L4s@hackingne.ws
    • UI: unknown version
    • BE: 0.19.8
    • Modlog
    • Instances
    • Docs
    • Code
    • join-lemmy.org