Navigation

    Gpushare.com

    • Register
    • Login
    • Search
    • Popular
    • Categories
    • Recent
    • Tags

    【实用代码分享】oss上传下载数据前,对数据进行压缩

    技术分享📚有奖励
    2
    5
    96
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • 173****7719
      173****7719 last edited by 173****7719

      前言

      本文是对使用oss数据进行上传下载数据的一个补充,针对的是对linux系统不熟悉的用户群体。

      例子

      假如我们现在在/hy-tmp这个文件夹里,里面的文件排列如下:

      • Data
        – train.npy
        – test.npy
      • Model
        – cnn.pt
        – lstm.pt

      登录oss后

      操作1: 对训练数据进行压缩

      zip train.zip Data/train.npy 
      

      操作2: 对整个数据集进行压缩

      zip -r data.zip Data/ 
      

      操作3:对测试数据和cnn模型进行压缩

      zip testing.zip Data/train.npy Model/cnn.pt
      

      操作4: 对所有数据集和所有模型进行压缩

      zip all.zip .
      

      上传数据

      oss cp 个人数据.zip oss://datasets/
      # 上传成功后记得退出oss,
      oss logout
      # 并且删除压缩文件
      rm 个人数据.zip
      
      
      1 Reply Last reply Reply Quote 2
      • 173****7719
        173****7719 @Alice_恒源云 last edited by

        @alice_恒源云 10点多把

        1 Reply Last reply Reply Quote 0
        • Alice_恒源云
          Alice_恒源云 @173****7719 last edited by

          @173-7719 我想知道你几点睡的

          173****7719 1 Reply Last reply Reply Quote 0
          • 173****7719
            173****7719 @Alice_恒源云 last edited by

            @alice_恒源云 老人作息,六点多就自然醒了。。。

            Alice_恒源云 1 Reply Last reply Reply Quote 0
            • Alice_恒源云
              Alice_恒源云 last edited by Alice_恒源云

              阿洲起地好早(打哈欠

              173****7719 1 Reply Last reply Reply Quote 0
              • Referenced by  Alice_恒源云 Alice_恒源云 
              • First post
                Last post