Differences between revisions 2 and 9 (spanning 7 versions)

Amazon Web Services - Cloud provider

2018 CloudWatch syslog

Install agent

$ sudo dpkg -iE amazon-cloudwatch-agent.deb
$ sudo systemctl enable amazon-cloudwatch-agent.service
$ sudo systemctl start amazon-cloudwatch-agent.service
$ sudo systemctl status amazon-cloudwatch-agent.service

syslog

curl https://s3.amazonaws.com/aws-cloudwatch/downloads/latest/awslogs-agent-setup.py -O 
$ sudo python3 awslogs-agent-setup.py
awslogs-agent-setup.py

aws cli cloudwatch log groups

$ aws logs describe-log-groups --profile nonprod

2018 aws tool, setup for s3 upload on Raspberry Pi3

sudo pip3 install -U aws
- Error
- sudo apt install libffi-dev libssl-dev

2016

2016-aws-live
AWS-Partner-infor
on linux can use $s3cmd to backup to S3 storage in AWS.
- $ s3cmd --configure
  - get keys from http://aws.amazon.com/ User Name,Access Key Id,Secret Access Key
  - s3cmd mb s3://backupVigor
    - Bucket 's3://backupVigor/' created
- Use tar with the incremental option to backup files, pipe through xz to compress, pgp to encrypt if needed and then pipe straight to s3cmd, into backup file.
  - 20160322 - This works great, and no need for a local copy of the file while creating the backup.
Then set AWS policy on s3 bucket to move older files to Glacier, and even delete very old files, e.g. after 700days.

Linux commandline bash upload to aws s3

https://geek.co.il/2014/05/26/script-day-upload-files-to-amazon-s3-using-bash

...

CategoryStorage CategoryDevelopement CategorySecurity

-  ⇤ ← Revision 2 as of 2016-03-19 08:59:39 → 
  Size: 295
  Editor: PieterSmit
  Comment:
+   ← Revision 9 as of 2021-02-17 01:23:32 → ⇥
  Size: 2142
  Editor: PieterSmit
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 4:
+== 2018 CloudWatch syslog ==
 * Install agent {{{
$ sudo dpkg -iE amazon-cloudwatch-agent.deb
$ sudo systemctl enable amazon-cloudwatch-agent.service
$ sudo systemctl start amazon-cloudwatch-agent.service
$ sudo systemctl status amazon-cloudwatch-agent.service
 }}}
 * --( syslog {{{
curl https://s3.amazonaws.com/aws-cloudwatch/downloads/latest/awslogs-agent-setup.py -O 
$ sudo python3 awslogs-agent-setup.py
awslogs-agent-setup.py
}}} )--
 * aws cli cloudwatch log groups {{{
$ aws logs describe-log-groups --profile nonprod
}}}
== 2018 aws tool, setup for s3 upload on Raspberry Pi3 ==
 * sudo pip3 install -U aws
    * Error
    * sudo apt install libffi-dev libssl-dev


== 2016 ==
 * [[https://live.awsevents.com/?sc_channel=em&sc_campaign=chicagosummit2016&sc_publisher=aws&sc_medium=em_13869&sc_content=launch_t1launch_tier1&sc_country=global&sc_geo=global&sc_category=mult&sc_outcome=launch&trk=ema_13869&mkt_tok=eyJpIjoiTWpZMk1XTmtPVGRrTmpnMSIsInQiOiJVb3VIVURraVRGNTRKNEtWNzNjNTlJWmlPUmRwSDRyWFhzaG1PSHY1YXJcL0swRnpKd1BhUEFMdzNGMU53UTd4Mkd6WlJyM1htWGladlNBNHpZMk1sUTIxR3NzTlB4RDdOYnVvaDlZRHErXC9RPSJ9|2016-aws-live]]
 * [[https://aws.amazon.com/partners/success/infor/|AWS-Partner-infor]]
-Line 7:
+Line 32:
+     * s3cmd mb s3://backupVigor
       {{{ Bucket 's3://backupVigor/' created }}}
   * Use tar with the incremental option to backup files, pipe through xz to compress, pgp to encrypt if needed and then pipe straight to s3cmd, into backup file.
     * 20160322 - This works great, and no need for a local copy of the file while creating the backup.
 * Then set AWS policy on s3 bucket to move older files to Glacier, and even delete very old files, e.g. after 700days.
== Linux commandline bash upload to aws s3 ==
 * https://geek.co.il/2014/05/26/script-day-upload-files-to-amazon-s3-using-bash
-Line 10:
+Line 42:
-CategoryStorage CategoryDevelopement
+CategoryStorage CategoryDevelopement CategorySecurity